Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
335.250872ms
FAIL (2025-08-09 04:27:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 335.272342ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [X..X.......X........X..X..........................X.........] duration:
272.997ms
FAIL (2025-08-09 04:27:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 273.021455ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X..X.......X........X..X..........................X........] duration:
392.834194ms
FAIL (2025-08-09 04:26:46 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 392.854983ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X..........................X......X................] duration:
168.52013ms
FAIL (2025-08-09 04:26:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.544106ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.........X........X.............................X.....] duration:
374.532409ms
FAIL (2025-08-09 04:26:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 374.547948ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X..X.......X........X..X..........................X.......] duration:
212.228565ms
FAIL (2025-08-09 04:26:19 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 212.243053ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X..........................X......X...............] duration:
226.939563ms
FAIL (2025-08-09 04:26:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 226.963368ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X.........X........X.............................X....] duration:
652.382326ms
FAIL (2025-08-09 04:26:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 652.398036ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
37.770156ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:26:00 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 37.79343ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
323.623095ms
FAIL (2025-08-09 04:25:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 323.642802ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X..X.......X........X..X..........................X......] duration:
188.557273ms
FAIL (2025-08-09 04:25:29 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 188.626363ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X.........X........X.............................X...] duration:
444.810068ms
FAIL (2025-08-09 04:25:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 444.828592ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
499.634642ms
FAIL (2025-08-09 04:25:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 499.658867ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X..X.......X........X..X..........................X.....] duration:
384.933149ms
FAIL (2025-08-09 04:25:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 384.94967ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X..........................X......X..............] duration:
157.538671ms
FAIL (2025-08-09 04:25:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 157.573446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X.........X........X.............................X..] duration:
789.186795ms
FAIL (2025-08-09 04:25:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 789.205089ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
397.769005ms
FAIL (2025-08-09 04:24:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 397.789975ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
30.150241ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:24:48 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 30.169117ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
364.549954ms
FAIL (2025-08-09 04:24:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 364.571695ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X.........X........X.............................X.] duration:
488.063349ms
FAIL (2025-08-09 04:24:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 488.077045ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X..X.......X........X..X..........................X....] duration:
3.502476492s
FAIL (2025-08-09 04:24:11 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 3.502498372s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
411.810587ms
FAIL (2025-08-09 04:24:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 411.846073ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X..........................X......X.............] duration:
148.140016ms
FAIL (2025-08-09 04:23:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.156467ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
46.791057ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:23:56 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 46.80929ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X..X.......X........X..X..........................X...] duration:
493.3668ms
FAIL (2025-08-09 04:23:30 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 493.388591ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X..........................X......X............] duration:
153.063719ms
FAIL (2025-08-09 04:23:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.081361ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.........X........X.............................] duration:
385.08956ms
FAIL (2025-08-09 04:23:07 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 385.108396ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
608.847521ms
FAIL (2025-08-09 04:23:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 608.865536ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
27.965775ms remote:
"tcp:45.38.24.2:443" target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-09 04:22:52 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded
Duration: 27.981022ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X..X.......X........X..X..........................X..] duration:
208.68594ms
FAIL (2025-08-09 04:22:52 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 208.704735ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.........X........X............................] duration:
497.738363ms
FAIL (2025-08-09 04:22:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 497.75271ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
384.065857ms
FAIL (2025-08-09 04:22:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 384.086836ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X..X.......X........X..X..........................X.] duration:
285.401526ms
FAIL (2025-08-09 04:22:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 285.421985ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X..........................X......X...........] duration:
155.156075ms
FAIL (2025-08-09 04:22:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.176885ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X..........................X......X..........] duration:
183.229481ms
FAIL (2025-08-09 04:21:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.254257ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.........X........X...........................] duration:
590.386431ms
FAIL (2025-08-09 04:21:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 590.403764ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X..X.......X........X..X..........................X] duration:
10.002005973s
FAIL (2025-08-09 04:21:42 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 10.002120077s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
412.321403ms
FAIL (2025-08-09 04:21:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 412.35168ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X..........................X......X.........] duration:
347.101114ms
FAIL (2025-08-09 04:21:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 347.122482ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.........X........X..........................] duration:
560.430442ms
FAIL (2025-08-09 04:21:09 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 560.443698ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X..........................X......X........] duration:
182.732983ms
FAIL (2025-08-09 04:21:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 182.764682ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X..X.......X........X..X..........................] duration:
195.57806ms
FAIL (2025-08-09 04:20:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 195.594512ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
414.080818ms
FAIL (2025-08-09 04:20:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 414.106174ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X..X.......X........X..X.........................] duration:
486.782483ms
FAIL (2025-08-09 04:20:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 486.80828ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.........X........X.........................] duration:
626.862835ms
FAIL (2025-08-09 04:20:03 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 626.884155ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X..........................X......X.......] duration:
154.9664ms
FAIL (2025-08-09 04:19:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:15:11.760338602 (10h48m52.491606252s) [upload=11241]: Starting upload Aug 9 04:15:11.760413601 (10h48m52.491681252s) [upload=11241]: Done starting upload Aug 9 04:15:11.760493040 (10h48m52.49176067s) [upload=11241]: Uploading segments... Aug 9 04:15:11.760535319 (10h48m52.491802949s) [upload=11241]: Got next segment. Inline: true Aug 9 04:15:11.760566247 (10h48m52.491833867s) [upload=11241]: Waiting for error group managing segments... Aug 9 04:15:11.760600520 (10h48m52.491868151s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:15:11.760604838 (10h48m52.491872468s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 04:15:11.760607373 (10h48m52.491875003s) [upload=11241]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 04:15:11.763166731 (10h48m52.494434361s) [upload=11241]: Done uploading segments... Aug 9 04:15:11.763174686 (10h48m52.494442306s) [upload=11241]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.987329ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.........X........X........................] duration:
414.826268ms
FAIL (2025-08-09 04:19:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 414.852507ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
18.402603ms
FAIL (2025-08-09 04:19:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 04:19:22.181167275 (10h53m2.912434924s) [upload=11315]: Starting upload Aug 9 04:19:22.181227848 (10h53m2.912495498s) [upload=11315]: Done starting upload Aug 9 04:19:22.181322314 (10h53m2.912589964s) [upload=11315]: Uploading segments... Aug 9 04:19:22.181693828 (10h53m2.912961478s) [upload=11315]: Got next segment. Inline: false Aug 9 04:19:22.181740875 (10h53m2.913008525s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 04:19:22.181747157 (10h53m2.913014817s) [upload=11315]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 04:19:22.184364102 (10h53m2.915631752s) [upload=11315]: Next segment err: metaclient: Too Many Requests Aug 9 04:19:22.184378198 (10h53m2.915645859s) [upload=11315]: Done uploading segments... Aug 9 04:19:22.184391233 (10h53m2.915658883s) [upload=11315]: Upload finished. err: metaclient: Too Many Requests
Duration: 18.425094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X..X.......X........X..X........................] duration:
398.029323ms
FAIL (2025-08-09 04:19:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 398.196496ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.........X........X.......................] duration:
403.299822ms
FAIL (2025-08-09 04:19:17 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout
Duration: 403.369803ms
edge
gateway
us-select-1
|