Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 117729 reports (Page 1515 of 2355)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [................X...X..........X.X...............X..........]
duration:
147.807583ms
FAIL (2025-08-22 01:32:23 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 147.831729ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [.................X...X..........X.X...............X.........]
duration:
177.325485ms
FAIL (2025-08-22 01:31:43 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 177.348478ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [..................X...X..........X.X...............X........]
duration:
591.327785ms
FAIL (2025-08-22 01:31:01 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 591.347763ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [...................X...X..........X.X...............X.......]
duration:
476.122002ms
FAIL (2025-08-22 01:30:01 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 476.143523ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [....................X...X..........X.X...............X......]
duration:
181.503221ms
FAIL (2025-08-22 01:29:35 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 181.52883ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [.....................X...X..........X.X...............X.....]
duration:
173.307501ms
FAIL (2025-08-22 01:29:18 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 173.330013ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [......................X...X..........X.X...............X....]
duration:
250.837716ms
FAIL (2025-08-22 01:28:26 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 250.856392ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [.......................X...X..........X.X...............X...]
duration:
968.400393ms
FAIL (2025-08-22 01:27:29 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 968.424018ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [........................X...X..........X.X...............X..]
duration:
211.986567ms
FAIL (2025-08-22 01:26:33 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 212.014099ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
1.321746006s
FAIL (2025-08-22 01:25:44 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.321775631s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [.........................X...X..........X.X...............X.]
duration:
349.680092ms
FAIL (2025-08-22 01:25:41 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 349.701713ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [..........................X...X..........X.X...............X]
duration:
209.016345ms
FAIL (2025-08-22 01:25:05 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:25:05.455027569 (319h58m46.186295199s) [upload=332692]: Starting upload
Aug 22 01:25:05.455061302 (319h58m46.186328922s) [upload=332692]: Done starting upload
Aug 22 01:25:05.455129301 (319h58m46.186396921s) [upload=332692]: Uploading segments...
Aug 22 01:25:05.455183463 (319h58m46.186451093s) [upload=332692]: Got next segment. Inline: true
Aug 22 01:25:05.455189755 (319h58m46.186457385s) [upload=332692]: Waiting for error group managing segments...
Aug 22 01:25:05.455231283 (319h58m46.186498904s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:25:05.455235130 (319h58m46.186502751s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:25:05.455237615 (319h58m46.186505245s) [upload=332692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:25:05.591511697 (319h58m46.322779327s) [upload=332692]: Done uploading segments...
Aug 22 01:25:05.591525203 (319h58m46.322792823s) [upload=332692]: Upload finished. err: <nil>
Duration: 209.038537ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
1.174118991s
FAIL (2025-08-22 01:24:40 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.174140551s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
437.64704ms
FAIL (2025-08-22 01:24:20 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 437.692075ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [...........................X...X..........X.X...............]
duration:
146.968459ms
FAIL (2025-08-22 01:24:19 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 146.994608ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [X..X........................................................]
duration:
1.203800605s
FAIL (2025-08-22 01:23:19 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.20381907s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [............................X...X..........X.X..............]
duration:
184.469088ms
FAIL (2025-08-22 01:23:15 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 184.489165ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.............................X...X..........X.X.............]
duration:
289.294045ms
FAIL (2025-08-22 01:22:08 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 289.328089ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.X..X.......................................................]
duration:
1.338458715s
FAIL (2025-08-22 01:22:04 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.338487338s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..............................X...X..........X.X............]
duration:
218.061275ms
FAIL (2025-08-22 01:21:20 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 218.078389ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..X..X......................................................]
duration:
1.262454732s
FAIL (2025-08-22 01:21:13 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.262482104s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [...............................X...X..........X.X...........]
duration:
153.888015ms
FAIL (2025-08-22 01:20:37 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 153.907152ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...X..X.....................................................]
duration:
1.407952913s
FAIL (2025-08-22 01:20:13 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.407990424s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [................................X...X..........X.X..........]
duration:
438.18288ms
FAIL (2025-08-22 01:19:47 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 438.20349ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [....X..X....................................................]
duration:
601.035374ms
FAIL (2025-08-22 01:19:37 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 601.057335ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.....X..X...................................................]
duration:
535.503018ms
FAIL (2025-08-22 01:19:09 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 535.523194ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.................................X...X..........X.X.........]
duration:
212.170662ms
FAIL (2025-08-22 01:18:55 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 212.190341ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [......X..X..................................................]
duration:
2.661558377s
FAIL (2025-08-22 01:18:39 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.661582584s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..................................X...X..........X.X........]
duration:
177.15261ms
FAIL (2025-08-22 01:18:16 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 177.176627ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [...................................X...X..........X.X.......]
duration:
358.517552ms
FAIL (2025-08-22 01:17:42 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 358.544092ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.......X..X.................................................]
duration:
1.847089838s
FAIL (2025-08-22 01:17:31 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.847116648s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [........X..X................................................]
duration:
584.418024ms
FAIL (2025-08-22 01:17:06 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 584.440016ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.........X..X...............................................]
duration:
2.600200318s
FAIL (2025-08-22 01:16:43 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.600222389s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [....................................X...X..........X.X......]
duration:
555.526328ms
FAIL (2025-08-22 01:16:30 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 555.549902ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.....................................X...X..........X.X.....]
duration:
146.887816ms
FAIL (2025-08-22 01:15:48 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 146.903757ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........X..X..............................................]
duration:
1.513753368s
FAIL (2025-08-22 01:15:38 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.513781761s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [......................................X...X..........X.X....]
duration:
184.012147ms
FAIL (2025-08-22 01:15:14 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 184.029529ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.......................................X...X..........X.X...]
duration:
240.690301ms
FAIL (2025-08-22 01:14:41 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 240.706813ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...........X..X.............................................]
duration:
1.812539325s
FAIL (2025-08-22 01:14:40 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.812565034s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [............X..X............................................]
duration:
1.421637348s
FAIL (2025-08-22 01:14:20 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.42166491s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.............X..X...........................................]
duration:
631.635821ms
FAIL (2025-08-22 01:13:41 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 631.66739ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [........................................X...X..........X.X..]
duration:
247.953328ms
FAIL (2025-08-22 01:13:29 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 247.98168ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..............X..X..........................................]
duration:
578.293105ms
FAIL (2025-08-22 01:13:14 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 578.360223ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.........................................X...X..........X.X.]
duration:
395.231788ms
FAIL (2025-08-22 01:12:31 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 395.257096ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...............X..X.........................................]
duration:
559.164439ms
FAIL (2025-08-22 01:12:25 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 559.215454ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..........................................X...X..........X.X]
duration:
504.592437ms
FAIL (2025-08-22 01:11:55 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 22 01:11:54.766576600 (319h45m35.497844231s) [upload=332474]: Starting upload
Aug 22 01:11:54.766635420 (319h45m35.49790304s) [upload=332474]: Done starting upload
Aug 22 01:11:54.766693770 (319h45m35.4979614s) [upload=332474]: Uploading segments...
Aug 22 01:11:54.766728737 (319h45m35.497996367s) [upload=332474]: Got next segment. Inline: true
Aug 22 01:11:54.766732283 (319h45m35.497999903s) [upload=332474]: Waiting for error group managing segments...
Aug 22 01:11:54.766766377 (319h45m35.498033997s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:11:54.766770154 (319h45m35.498037774s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:11:54.766772629 (319h45m35.498040249s) [upload=332474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:11:55.199842200 (319h45m35.93110985s) [upload=332474]: Done uploading segments...
Aug 22 01:11:55.199872117 (319h45m35.931139767s) [upload=332474]: Upload finished. err: <nil>
Duration: 504.62545ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [................X..X........................................]
duration:
2.230040702s
FAIL (2025-08-22 01:11:31 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.230061161s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [...........................................X...X..........X.]
duration:
628.480871ms
FAIL (2025-08-22 01:11:02 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 01:10:30.660351066 (319h44m11.391618715s) [upload=332445]: Starting upload
Aug 22 01:10:30.660418572 (319h44m11.391686222s) [upload=332445]: Done starting upload
Aug 22 01:10:30.660537336 (319h44m11.391804986s) [upload=332445]: Uploading segments...
Aug 22 01:10:30.660592681 (319h44m11.39186033s) [upload=332445]: Got next segment. Inline: true
Aug 22 01:10:30.660599013 (319h44m11.391866662s) [upload=332445]: Waiting for error group managing segments...
Aug 22 01:10:30.660670486 (319h44m11.391938147s) [upload=332445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:10:30.660676778 (319h44m11.391944438s) [upload=332445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:10:30.660680415 (319h44m11.391948065s) [upload=332445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:10:30.668038190 (319h44m11.399305839s) [upload=332445]: Done uploading segments...
Aug 22 01:10:30.668051645 (319h44m11.399319295s) [upload=332445]: Upload finished. err: metaclient: Too Many Requests
Duration: 628.498265ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.................X..X.......................................]
duration:
2.207596422s
FAIL (2025-08-22 01:10:36 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 00:44:31.255583283 (319h18m11.986850913s) [upload=331993]: Starting upload
Aug 22 00:44:31.255629219 (319h18m11.986896839s) [upload=331993]: Done starting upload
Aug 22 00:44:31.255699431 (319h18m11.986967092s) [upload=331993]: Uploading segments...
Aug 22 00:44:31.255866666 (319h18m11.987134296s) [upload=331993]: Got next segment. Inline: false
Aug 22 00:44:31.255897984 (319h18m11.987165614s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 00:44:31.255902042 (319h18m11.987169662s) [upload=331993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 22 00:44:31.258916047 (319h18m11.990183677s) [upload=331993]: Next segment err: metaclient: Too Many Requests
Aug 22 00:44:31.258925735 (319h18m11.990193355s) [upload=331993]: Done uploading segments...
Aug 22 00:44:31.258952145 (319h18m11.990219775s) [upload=331993]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.207616731s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
3 out of 60 is failed (threshold=3) [............................................X...X..........X]
duration:
25.612844ms
FAIL (2025-08-22 01:10:30 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: too many requests
======LOGS======
Aug 22 01:10:30.660351066 (319h44m11.391618715s) [upload=332445]: Starting upload
Aug 22 01:10:30.660418572 (319h44m11.391686222s) [upload=332445]: Done starting upload
Aug 22 01:10:30.660537336 (319h44m11.391804986s) [upload=332445]: Uploading segments...
Aug 22 01:10:30.660592681 (319h44m11.39186033s) [upload=332445]: Got next segment. Inline: true
Aug 22 01:10:30.660599013 (319h44m11.391866662s) [upload=332445]: Waiting for error group managing segments...
Aug 22 01:10:30.660670486 (319h44m11.391938147s) [upload=332445]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 01:10:30.660676778 (319h44m11.391944438s) [upload=332445]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 01:10:30.660680415 (319h44m11.391948065s) [upload=332445]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 01:10:30.668038190 (319h44m11.399305839s) [upload=332445]: Done uploading segments...
Aug 22 01:10:30.668051645 (319h44m11.399319295s) [upload=332445]: Upload finished. err: metaclient: Too Many Requests
Duration: 25.640537ms core uplink us-select-1 us1-placement-20 metainfo-projects