Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
16.711001ms
FAIL (2025-08-28 03:19:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 03:19:17.907342448 (9h40m41.136827835s) [upload=10025]: Starting upload Aug 28 03:19:17.907407560 (9h40m41.136892937s) [upload=10025]: Done starting upload Aug 28 03:19:17.907477272 (9h40m41.136962649s) [upload=10025]: Uploading segments... Aug 28 03:19:17.907514572 (9h40m41.136999949s) [upload=10025]: Got next segment. Inline: true Aug 28 03:19:17.907520152 (9h40m41.13700553s) [upload=10025]: Waiting for error group managing segments... Aug 28 03:19:17.907568372 (9h40m41.13705375s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 03:19:17.907574675 (9h40m41.137060051s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 03:19:17.907578672 (9h40m41.137064049s) [upload=10025]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 03:19:17.910171414 (9h40m41.13965679s) [upload=10025]: Done uploading segments... Aug 28 03:19:17.910184448 (9h40m41.139669825s) [upload=10025]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.759492ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............................................XX...X.X.X.....] duration:
2.897353018s
FAIL (2025-08-28 03:19:15 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.897375289s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
16.807001971s
FAIL (2025-08-28 03:18:42 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 16.807050543s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............................................XX...X.X.X....] duration:
18.745044575s
FAIL (2025-08-28 03:18:35 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 18.745067868s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
395.553653ms
FAIL (2025-08-28 03:18:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 395.581014ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
178.747432ms
FAIL (2025-08-28 03:17:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 178.76772ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
468.514019ms
FAIL (2025-08-28 03:17:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 468.537001ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
839.355962ms
FAIL (2025-08-28 03:17:28 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 839.376279ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............................................XX...X.X.X...] duration:
2.90557507s
FAIL (2025-08-28 03:17:19 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.90560094s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
939.771341ms
FAIL (2025-08-28 03:16:51 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 939.796558ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
159.044628ms
FAIL (2025-08-28 03:16:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 159.075516ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
700.331671ms
FAIL (2025-08-28 03:16:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 700.358932ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [................................................XX...X.X.X..] duration:
18.207921854s
FAIL (2025-08-28 03:16:41 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 18.207948244s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
890.608319ms
FAIL (2025-08-28 03:16:16 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 890.644617ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................................................XX...X.X.X.] duration:
2.966683756s
FAIL (2025-08-28 03:16:05 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.966711278s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
352.323176ms
FAIL (2025-08-28 03:15:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 352.339818ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
372.94993ms
FAIL (2025-08-28 03:15:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 372.973303ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................................................XX...X.X.X] duration:
30.004199747s
FAIL (2025-08-28 03:15:34 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.004213183s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
966.419942ms
FAIL (2025-08-28 03:15:15 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 966.437435ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
351.623889ms
FAIL (2025-08-28 03:14:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 351.679224ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
337.780259ms
FAIL (2025-08-28 03:14:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 337.807209ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
979.98531ms
FAIL (2025-08-28 03:14:31 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 980.028231ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...................................................XX...X.X.] duration:
3.191266056s
FAIL (2025-08-28 03:14:30 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.191288497s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
30.001065413s
FAIL (2025-08-28 03:14:27 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 30.001086663s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....................................................XX...X.X] duration:
34.762109282s
FAIL (2025-08-28 03:14:26 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 34.762130372s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
181.955431ms
FAIL (2025-08-28 03:14:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 181.978224ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
394.50435ms
FAIL (2025-08-28 03:14:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 394.525309ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
146.702172ms
FAIL (2025-08-28 03:13:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.731789ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................................................XX...X.] duration:
28.640744741s
FAIL (2025-08-28 03:13:47 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 28.64077048s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
471.692292ms
FAIL (2025-08-28 03:13:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 471.715677ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
29.633774642s
FAIL (2025-08-28 03:13:35 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 29.633797384s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................................................XX...X] duration:
30.007590826s
FAIL (2025-08-28 03:13:18 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.007621132s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000842934s
FAIL (2025-08-28 03:12:36 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 30.000860255s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
124.543355ms
FAIL (2025-08-28 03:12:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 124.571448ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
662.302479ms
FAIL (2025-08-28 03:12:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 662.328718ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...] duration:
3.208093438s
FAIL (2025-08-28 03:12:21 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.208139925s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
391.996856ms
FAIL (2025-08-28 03:12:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 392.021414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
148.204997ms
FAIL (2025-08-28 03:11:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.252857ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................................XX..] duration:
3.09091448s
FAIL (2025-08-28 03:11:22 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.090945558s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
137.494686ms
FAIL (2025-08-28 03:11:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 137.528598ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
345.068874ms
FAIL (2025-08-28 03:11:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 345.092008ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
401.563476ms
FAIL (2025-08-28 03:10:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 401.584766ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
130.887606ms
FAIL (2025-08-28 03:10:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 130.91035ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
2.787568936s
FAIL (2025-08-28 03:10:07 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 2.787597319s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
330.361428ms
FAIL (2025-08-28 03:09:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 330.390092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.015468848s
FAIL (2025-08-28 03:09:21 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 30.015508753s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
386.255924ms
FAIL (2025-08-28 03:09:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:31:23.970998919 (8h52m47.200484295s) [upload=9208]: Starting upload Aug 28 02:31:23.971055043 (8h52m47.200540421s) [upload=9208]: Done starting upload Aug 28 02:31:23.971119285 (8h52m47.200604662s) [upload=9208]: Uploading segments... Aug 28 02:31:23.971168747 (8h52m47.200654155s) [upload=9208]: Got next segment. Inline: true Aug 28 02:31:23.971174369 (8h52m47.200659755s) [upload=9208]: Waiting for error group managing segments... Aug 28 02:31:23.971235624 (8h52m47.200721011s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:31:23.971241385 (8h52m47.200726762s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 02:31:23.971244771 (8h52m47.200730149s) [upload=9208]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 02:31:23.976972575 (8h52m47.206457952s) [upload=9208]: Done uploading segments... Aug 28 02:31:23.976984588 (8h52m47.206469964s) [upload=9208]: Upload finished. err: metaclient: Too Many Requests
Duration: 386.286452ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
695.423599ms
FAIL (2025-08-28 03:09:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 695.443928ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.009607642s
FAIL (2025-08-28 03:08:51 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 30.009632458s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
429.922672ms
FAIL (2025-08-28 03:08:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 02:47:44.611300761 (9h9m7.840786109s) [upload=9486]: Starting upload Aug 28 02:47:44.611340746 (9h9m7.840826094s) [upload=9486]: Done starting upload Aug 28 02:47:44.611428663 (9h9m7.84091402s) [upload=9486]: Uploading segments... Aug 28 02:47:44.611668895 (9h9m7.841154252s) [upload=9486]: Got next segment. Inline: false Aug 28 02:47:44.611695745 (9h9m7.841181092s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 02:47:44.611699653 (9h9m7.841185s) [upload=9486]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 02:47:44.671595480 (9h9m7.901080837s) [upload=9486]: Next segment err: metaclient: Too Many Requests Aug 28 02:47:44.671612302 (9h9m7.901097648s) [upload=9486]: Done uploading segments... Aug 28 02:47:44.671629464 (9h9m7.901114821s) [upload=9486]: Upload finished. err: metaclient: Too Many Requests
Duration: 429.959452ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|