Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
10.528728247s
FAIL (2025-08-28 03:29:30 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 10.528753815s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
108.072367ms
FAIL (2025-08-28 03:29:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 108.092566ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
529.904388ms
FAIL (2025-08-28 03:29:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 529.923202ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............................XX...X.X.X...................] duration:
9.388176768s
FAIL (2025-08-28 03:29:10 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 9.388198218s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
8.619600993s
FAIL (2025-08-28 03:28:30 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 8.619624247s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [................................XX...X.X.X..................] duration:
2.894639269s
FAIL (2025-08-28 03:28:25 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.894672161s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
149.064646ms
FAIL (2025-08-28 03:28:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.099141ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
384.938477ms
FAIL (2025-08-28 03:28:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 384.991458ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................................XX...X.X.X.................] duration:
11.597263176s
FAIL (2025-08-28 03:27:39 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 11.597291027s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
976.108399ms
FAIL (2025-08-28 03:27:34 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 976.133659ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
377.901619ms
FAIL (2025-08-28 03:27:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 377.925054ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
120.750539ms
FAIL (2025-08-28 03:27:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 120.78274ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................................XX...X.X.X................] duration:
7.256874489s
FAIL (2025-08-28 03:26:58 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 7.256901391s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
4.277161654s
FAIL (2025-08-28 03:26:46 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.277181041s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
439.090722ms
FAIL (2025-08-28 03:26:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 439.120899ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................................XX...X.X.X...............] duration:
9.45299979s
FAIL (2025-08-28 03:26:14 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 9.453024085s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
370.224276ms
FAIL (2025-08-28 03:26:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 370.246218ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
144.461709ms
FAIL (2025-08-28 03:26:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 144.48958ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
370.148691ms
FAIL (2025-08-28 03:25:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 370.172366ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
161.242664ms
FAIL (2025-08-28 03:25:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.269905ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................................XX...X.X.X..............] duration:
2.837488512s
FAIL (2025-08-28 03:25:48 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.837516014s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.563164475s
FAIL (2025-08-28 03:25:43 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.563196295s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
112.947939ms
FAIL (2025-08-28 03:25:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 112.987653ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
360.821483ms
FAIL (2025-08-28 03:24:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 360.893177ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................................XX...X.X.X.............] duration:
2.915143336s
FAIL (2025-08-28 03:24:43 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.915197257s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
866.831376ms
FAIL (2025-08-28 03:24:43 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 866.85526ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
128.826692ms
FAIL (2025-08-28 03:24:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.858041ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
351.185691ms
FAIL (2025-08-28 03:24:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 351.208503ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................................XX...X.X.X............] duration:
3.160046887s
FAIL (2025-08-28 03:24:10 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.1600694s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
199.865005ms
FAIL (2025-08-28 03:24:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 199.883721ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
6.775292321s
FAIL (2025-08-28 03:23:41 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 6.77531214s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
595.611987ms
FAIL (2025-08-28 03:23:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 595.633899ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
148.134674ms
FAIL (2025-08-28 03:23:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.154241ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
944.301397ms
FAIL (2025-08-28 03:23:05 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 944.328739ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................................XX...X.X.X...........] duration:
2.980051396s
FAIL (2025-08-28 03:22:59 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.980079889s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
11.462360788s
FAIL (2025-08-28 03:22:47 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 11.462384202s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [........................................XX...X.X.X..........] duration:
2.890835569s
FAIL (2025-08-28 03:22:34 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.89086319s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
430.535786ms
FAIL (2025-08-28 03:22:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 430.555171ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
145.865692ms
FAIL (2025-08-28 03:22:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.884698ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........................................XX...X.X.X.........] duration:
2.956491641s
FAIL (2025-08-28 03:21:57 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.956514514s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
8.275139755s
FAIL (2025-08-28 03:21:49 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 8.275172055s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
522.046643ms
FAIL (2025-08-28 03:21:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 522.068253ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
910.732484ms
FAIL (2025-08-28 03:21:22 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 910.761679ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
365.041251ms
FAIL (2025-08-28 03:21:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 365.065377ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........................................XX...X.X.X........] duration:
3.043878554s
FAIL (2025-08-28 03:21:02 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.043901717s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
127.002927ms
FAIL (2025-08-28 03:21:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 127.030417ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
984.547147ms
FAIL (2025-08-28 03:20:59 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 984.570271ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........................................XX...X.X.X.......] duration:
10.893315646s
FAIL (2025-08-28 03:20:48 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 10.893339641s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.012051618s
FAIL (2025-08-28 03:20:25 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 1.012073168s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
410.531831ms
FAIL (2025-08-28 03:20:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 410.553402ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|