Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X........X..X..........................X...............] duration:
200.546104ms
FAIL (2025-08-09 04:31:26 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 200.568265ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X..........................X......X......................] duration:
336.012724ms
FAIL (2025-08-09 04:31:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 336.036959ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
401.610928ms
FAIL (2025-08-09 04:30:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 401.633309ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.........X........X.............................X..........] duration:
443.523306ms
FAIL (2025-08-09 04:30:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 443.545618ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
20.198414ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:30:43 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 20.221858ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X..........................X......X.....................] duration:
358.20972ms
FAIL (2025-08-09 04:30:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 358.235718ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X........X..X..........................X..............] duration:
235.157032ms
FAIL (2025-08-09 04:30:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 235.360042ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X..........................X......X....................] duration:
166.624922ms
FAIL (2025-08-09 04:30:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.646863ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.........X........X.............................X.........] duration:
463.867172ms
FAIL (2025-08-09 04:30:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 463.880848ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X........X..X..........................X.............] duration:
220.205425ms
FAIL (2025-08-09 04:30:04 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 220.231663ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
140.684879ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:30:00 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 140.703264ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X..........................X......X...................] duration:
328.019059ms
FAIL (2025-08-09 04:29:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 328.038556ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
494.81384ms
FAIL (2025-08-09 04:29:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 494.833036ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.........X........X.............................X........] duration:
5.412788961s
FAIL (2025-08-09 04:29:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.412809568s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
20.564488ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:29:02 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 20.623258ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
381.318688ms
FAIL (2025-08-09 04:28:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 381.347071ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.......X........X..X..........................X............] duration:
316.949167ms
FAIL (2025-08-09 04:28:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 316.968855ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
117.06665ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:28:36 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 117.090274ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X..........................X......X..................] duration:
195.380611ms
FAIL (2025-08-09 04:28:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 195.413432ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
406.403362ms
FAIL (2025-08-09 04:28:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 406.43925ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
43.636947ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:28:18 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 43.656785ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.........X........X.............................X.......] duration:
539.344678ms
FAIL (2025-08-09 04:28:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 539.368311ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.......X........X..X..........................X...........] duration:
535.290174ms
FAIL (2025-08-09 04:27:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 535.307246ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
383.16898ms
FAIL (2025-08-09 04:27:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 383.198755ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X..........................X......X.................] duration:
216.107852ms
FAIL (2025-08-09 04:27:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 216.131928ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.......X........X..X..........................X..........] duration:
190.134431ms
FAIL (2025-08-09 04:27:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 190.153576ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.........X........X.............................X......] duration:
385.521331ms
FAIL (2025-08-09 04:27:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 385.540957ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
28.380679ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:27:13 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 28.40275ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
335.250872ms
FAIL (2025-08-09 04:27:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 335.272342ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [X..X.......X........X..X..........................X.........] duration:
272.997ms
FAIL (2025-08-09 04:27:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 273.021455ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X..X.......X........X..X..........................X........] duration:
392.834194ms
FAIL (2025-08-09 04:26:46 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 392.854983ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..........................X......X................] duration:
168.52013ms
FAIL (2025-08-09 04:26:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.544106ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.........X........X.............................X.....] duration:
374.532409ms
FAIL (2025-08-09 04:26:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 374.547948ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X..X.......X........X..X..........................X.......] duration:
212.228565ms
FAIL (2025-08-09 04:26:19 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 212.243053ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..........................X......X...............] duration:
226.939563ms
FAIL (2025-08-09 04:26:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 226.963368ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.........X........X.............................X....] duration:
652.382326ms
FAIL (2025-08-09 04:26:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 652.398036ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
37.770156ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:26:00 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 37.79343ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
323.623095ms
FAIL (2025-08-09 04:25:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 323.642802ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X..X.......X........X..X..........................X......] duration:
188.557273ms
FAIL (2025-08-09 04:25:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 188.626363ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.........X........X.............................X...] duration:
444.810068ms
FAIL (2025-08-09 04:25:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 444.828592ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
499.634642ms
FAIL (2025-08-09 04:25:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 499.658867ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X..X.......X........X..X..........................X.....] duration:
384.933149ms
FAIL (2025-08-09 04:25:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 384.94967ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..........................X......X..............] duration:
157.538671ms
FAIL (2025-08-09 04:25:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 157.573446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.........X........X.............................X..] duration:
789.186795ms
FAIL (2025-08-09 04:25:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 789.205089ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
397.769005ms
FAIL (2025-08-09 04:24:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 397.789975ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
30.150241ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:24:48 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 30.169117ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
364.549954ms
FAIL (2025-08-09 04:24:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 364.571695ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X.........X........X.............................X.] duration:
488.063349ms
FAIL (2025-08-09 04:24:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 488.077045ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X..X.......X........X..X..........................X....] duration:
3.502476492s
FAIL (2025-08-09 04:24:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 3.502498372s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
411.810587ms
FAIL (2025-08-09 04:24:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 411.846073ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|