Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
375.293926ms
FAIL (2025-08-09 04:47:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 375.320066ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
414.47542ms
FAIL (2025-08-09 04:46:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 414.49185ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X......X.............................X..........] duration:
139.088839ms
FAIL (2025-08-09 04:46:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.118273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
405.032431ms
FAIL (2025-08-09 04:46:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 405.047038ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
20.159933ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:45:58 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 20.181602ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X......X.............................X.........] duration:
472.517908ms
FAIL (2025-08-09 04:45:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 472.539077ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
363.852199ms
FAIL (2025-08-09 04:45:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 363.867477ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
207.975002ms
FAIL (2025-08-09 04:45:52 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 207.991962ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
418.604696ms
FAIL (2025-08-09 04:45:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 418.627749ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
25.93886ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:45:21 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 25.961523ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
406.278968ms
FAIL (2025-08-09 04:45:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 406.298674ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X......X.............................X........] duration:
137.661615ms
FAIL (2025-08-09 04:45:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 137.681754ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
266.734467ms
FAIL (2025-08-09 04:44:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 266.754684ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
364.525356ms
FAIL (2025-08-09 04:44:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 364.547326ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.............................X.............................] duration:
384.544969ms
FAIL (2025-08-09 04:44:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 384.565166ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
26.833371ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:44:33 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 26.855533ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X......X.............................X.......] duration:
231.437277ms
FAIL (2025-08-09 04:44:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 231.455339ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
395.034688ms
FAIL (2025-08-09 04:44:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 395.057612ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
20.257626ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:44:02 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 20.272453ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
203.867543ms
FAIL (2025-08-09 04:43:45 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 203.886639ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.............................X............................] duration:
363.207315ms
FAIL (2025-08-09 04:43:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 363.232983ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
58.126304ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:43:41 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 58.143145ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
357.158183ms
FAIL (2025-08-09 04:43:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 357.18248ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
58.487871ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:43:10 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 58.509041ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X......X.............................X......] duration:
143.740243ms
FAIL (2025-08-09 04:43:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.770418ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.............................X...........................] duration:
411.629605ms
FAIL (2025-08-09 04:43:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 411.653791ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
363.273098ms
FAIL (2025-08-09 04:42:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 363.303505ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..........................X................................] duration:
193.678012ms
FAIL (2025-08-09 04:42:47 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 193.70454ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
30.418703ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:42:27 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 30.443039ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X..........................X...............................] duration:
454.479873ms
FAIL (2025-08-09 04:42:20 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 454.491224ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.............................X..........................] duration:
388.741747ms
FAIL (2025-08-09 04:42:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 388.760692ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X..........................X..............................] duration:
187.310346ms
FAIL (2025-08-09 04:42:03 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 187.329211ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X......X.............................X.....] duration:
434.882132ms
FAIL (2025-08-09 04:41:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 434.923569ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.............................X.........................] duration:
365.509693ms
FAIL (2025-08-09 04:41:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 365.527736ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
83.168161ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:41:42 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 83.185534ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
624.295553ms
FAIL (2025-08-09 04:41:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 624.314429ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [X..X..........................X.............................] duration:
385.165356ms
FAIL (2025-08-09 04:41:30 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 385.185992ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X......X.............................X....] duration:
214.518525ms
FAIL (2025-08-09 04:41:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 214.541839ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.............................X........................] duration:
372.197479ms
FAIL (2025-08-09 04:40:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 372.212007ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X..X..........................X............................] duration:
193.20031ms
FAIL (2025-08-09 04:40:43 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 193.251925ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
595.913237ms
FAIL (2025-08-09 04:40:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 595.954061ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
26.096885ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:40:34 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 26.119438ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.............................X.......................] duration:
382.933912ms
FAIL (2025-08-09 04:40:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 382.94866ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X......X.............................X...] duration:
152.447498ms
FAIL (2025-08-09 04:40:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 152.458789ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X..X..........................X...........................] duration:
187.693543ms
FAIL (2025-08-09 04:40:08 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 187.711255ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
17.617436ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:39:55 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 17.635952ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
23.529873ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:39:39 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 23.585308ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
589.93216ms
FAIL (2025-08-09 04:39:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 589.954221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.............................X......................] duration:
522.011573ms
FAIL (2025-08-09 04:39:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 522.027292ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X......X.............................X..] duration:
222.892797ms
FAIL (2025-08-09 04:39:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:37:45.976591970 (11h11m26.70785962s) [upload=11636]: Starting upload Aug 9 04:37:45.976658635 (11h11m26.707926285s) [upload=11636]: Done starting upload Aug 9 04:37:45.976753903 (11h11m26.708021563s) [upload=11636]: Uploading segments... Aug 9 04:37:45.976802863 (11h11m26.708070514s) [upload=11636]: Got next segment. Inline: true Aug 9 04:37:45.976808404 (11h11m26.708076054s) [upload=11636]: Waiting for error group managing segments... Aug 9 04:37:45.976853478 (11h11m26.708121139s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:37:45.976859770 (11h11m26.708127421s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:37:45.976863407 (11h11m26.708131058s) [upload=11636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:37:45.978946405 (11h11m26.710214055s) [upload=11636]: Done uploading segments... Aug 9 04:37:45.978959239 (11h11m26.710226899s) [upload=11636]: Upload finished. err: metaclient: Too Many Requests
Duration: 222.913256ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|