Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...............X........................X.......] duration:
422.349023ms
FAIL (2025-08-11 09:57:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:52:21.294133492 (64h26m2.025401132s) [upload=67067]: Starting upload Aug 11 09:52:21.294175059 (64h26m2.025442689s) [upload=67067]: Done starting upload Aug 11 09:52:21.294230943 (64h26m2.025498603s) [upload=67067]: Uploading segments... Aug 11 09:52:21.294472825 (64h26m2.025740465s) [upload=67067]: Got next segment. Inline: false Aug 11 09:52:21.294505976 (64h26m2.025773616s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:52:21.294510555 (64h26m2.025778195s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:52:21.297339947 (64h26m2.028607597s) [upload=67067]: Next segment err: metaclient: Too Many Requests Aug 11 09:52:21.297370684 (64h26m2.028638334s) [upload=67067]: Done uploading segments... Aug 11 09:52:21.297386925 (64h26m2.028654574s) [upload=67067]: Upload finished. err: metaclient: Too Many Requests
Duration: 422.369952ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X......X.............................................] duration:
208.649396ms
FAIL (2025-08-11 09:56:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 208.665196ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...............X........................X......] duration:
354.069522ms
FAIL (2025-08-11 09:56:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:52:21.294133492 (64h26m2.025401132s) [upload=67067]: Starting upload Aug 11 09:52:21.294175059 (64h26m2.025442689s) [upload=67067]: Done starting upload Aug 11 09:52:21.294230943 (64h26m2.025498603s) [upload=67067]: Uploading segments... Aug 11 09:52:21.294472825 (64h26m2.025740465s) [upload=67067]: Got next segment. Inline: false Aug 11 09:52:21.294505976 (64h26m2.025773616s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:52:21.294510555 (64h26m2.025778195s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:52:21.297339947 (64h26m2.028607597s) [upload=67067]: Next segment err: metaclient: Too Many Requests Aug 11 09:52:21.297370684 (64h26m2.028638334s) [upload=67067]: Done uploading segments... Aug 11 09:52:21.297386925 (64h26m2.028654574s) [upload=67067]: Upload finished. err: metaclient: Too Many Requests
Duration: 354.092795ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...............X........................X.....] duration:
376.442515ms
FAIL (2025-08-11 09:56:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:52:21.294133492 (64h26m2.025401132s) [upload=67067]: Starting upload Aug 11 09:52:21.294175059 (64h26m2.025442689s) [upload=67067]: Done starting upload Aug 11 09:52:21.294230943 (64h26m2.025498603s) [upload=67067]: Uploading segments... Aug 11 09:52:21.294472825 (64h26m2.025740465s) [upload=67067]: Got next segment. Inline: false Aug 11 09:52:21.294505976 (64h26m2.025773616s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:52:21.294510555 (64h26m2.025778195s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:52:21.297339947 (64h26m2.028607597s) [upload=67067]: Next segment err: metaclient: Too Many Requests Aug 11 09:52:21.297370684 (64h26m2.028638334s) [upload=67067]: Done uploading segments... Aug 11 09:52:21.297386925 (64h26m2.028654574s) [upload=67067]: Upload finished. err: metaclient: Too Many Requests
Duration: 376.469945ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X......X............................................] duration:
133.503899ms
FAIL (2025-08-11 09:56:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 133.530088ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X......X...........................................] duration:
152.818423ms
FAIL (2025-08-11 09:55:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 152.835745ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...............X........................X....] duration:
789.647088ms
FAIL (2025-08-11 09:55:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:52:21.294133492 (64h26m2.025401132s) [upload=67067]: Starting upload Aug 11 09:52:21.294175059 (64h26m2.025442689s) [upload=67067]: Done starting upload Aug 11 09:52:21.294230943 (64h26m2.025498603s) [upload=67067]: Uploading segments... Aug 11 09:52:21.294472825 (64h26m2.025740465s) [upload=67067]: Got next segment. Inline: false Aug 11 09:52:21.294505976 (64h26m2.025773616s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:52:21.294510555 (64h26m2.025778195s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:52:21.297339947 (64h26m2.028607597s) [upload=67067]: Next segment err: metaclient: Too Many Requests Aug 11 09:52:21.297370684 (64h26m2.028638334s) [upload=67067]: Done uploading segments... Aug 11 09:52:21.297386925 (64h26m2.028654574s) [upload=67067]: Upload finished. err: metaclient: Too Many Requests
Duration: 789.665132ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X......X..........................................] duration:
155.858069ms
FAIL (2025-08-11 09:54:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 155.877634ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X...............X........................X...] duration:
578.620112ms
FAIL (2025-08-11 09:54:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:52:21.294133492 (64h26m2.025401132s) [upload=67067]: Starting upload Aug 11 09:52:21.294175059 (64h26m2.025442689s) [upload=67067]: Done starting upload Aug 11 09:52:21.294230943 (64h26m2.025498603s) [upload=67067]: Uploading segments... Aug 11 09:52:21.294472825 (64h26m2.025740465s) [upload=67067]: Got next segment. Inline: false Aug 11 09:52:21.294505976 (64h26m2.025773616s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:52:21.294510555 (64h26m2.025778195s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:52:21.297339947 (64h26m2.028607597s) [upload=67067]: Next segment err: metaclient: Too Many Requests Aug 11 09:52:21.297370684 (64h26m2.028638334s) [upload=67067]: Done uploading segments... Aug 11 09:52:21.297386925 (64h26m2.028654574s) [upload=67067]: Upload finished. err: metaclient: Too Many Requests
Duration: 578.639819ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X......X.........................................] duration:
145.628473ms
FAIL (2025-08-11 09:53:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 145.65453ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X...............X........................X..] duration:
314.53997ms
FAIL (2025-08-11 09:53:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:52:21.294133492 (64h26m2.025401132s) [upload=67067]: Starting upload Aug 11 09:52:21.294175059 (64h26m2.025442689s) [upload=67067]: Done starting upload Aug 11 09:52:21.294230943 (64h26m2.025498603s) [upload=67067]: Uploading segments... Aug 11 09:52:21.294472825 (64h26m2.025740465s) [upload=67067]: Got next segment. Inline: false Aug 11 09:52:21.294505976 (64h26m2.025773616s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:52:21.294510555 (64h26m2.025778195s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:52:21.297339947 (64h26m2.028607597s) [upload=67067]: Next segment err: metaclient: Too Many Requests Aug 11 09:52:21.297370684 (64h26m2.028638334s) [upload=67067]: Done uploading segments... Aug 11 09:52:21.297386925 (64h26m2.028654574s) [upload=67067]: Upload finished. err: metaclient: Too Many Requests
Duration: 314.581208ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X......X........................................] duration:
162.942052ms
FAIL (2025-08-11 09:53:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 162.96227ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...............X........................X.] duration:
403.774558ms
FAIL (2025-08-11 09:53:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:52:21.294133492 (64h26m2.025401132s) [upload=67067]: Starting upload Aug 11 09:52:21.294175059 (64h26m2.025442689s) [upload=67067]: Done starting upload Aug 11 09:52:21.294230943 (64h26m2.025498603s) [upload=67067]: Uploading segments... Aug 11 09:52:21.294472825 (64h26m2.025740465s) [upload=67067]: Got next segment. Inline: false Aug 11 09:52:21.294505976 (64h26m2.025773616s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:52:21.294510555 (64h26m2.025778195s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:52:21.297339947 (64h26m2.028607597s) [upload=67067]: Next segment err: metaclient: Too Many Requests Aug 11 09:52:21.297370684 (64h26m2.028638334s) [upload=67067]: Done uploading segments... Aug 11 09:52:21.297386925 (64h26m2.028654574s) [upload=67067]: Upload finished. err: metaclient: Too Many Requests
Duration: 403.80759ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X......X.......................................] duration:
280.342922ms
FAIL (2025-08-11 09:52:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 280.369092ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X...............X........................X] duration:
14.997417ms
FAIL (2025-08-11 09:52:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:52:21.294133492 (64h26m2.025401132s) [upload=67067]: Starting upload Aug 11 09:52:21.294175059 (64h26m2.025442689s) [upload=67067]: Done starting upload Aug 11 09:52:21.294230943 (64h26m2.025498603s) [upload=67067]: Uploading segments... Aug 11 09:52:21.294472825 (64h26m2.025740465s) [upload=67067]: Got next segment. Inline: false Aug 11 09:52:21.294505976 (64h26m2.025773616s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:52:21.294510555 (64h26m2.025778195s) [upload=67067]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:52:21.297339947 (64h26m2.028607597s) [upload=67067]: Next segment err: metaclient: Too Many Requests Aug 11 09:52:21.297370684 (64h26m2.028638334s) [upload=67067]: Done uploading segments... Aug 11 09:52:21.297386925 (64h26m2.028654574s) [upload=67067]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.017083ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X...............X........................] duration:
336.886115ms
FAIL (2025-08-11 09:51:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 336.904269ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X......X......................................] duration:
148.234326ms
FAIL (2025-08-11 09:51:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 148.252971ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X...............X.......................] duration:
419.325458ms
FAIL (2025-08-11 09:51:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 419.350445ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X......X.....................................] duration:
122.772165ms
FAIL (2025-08-11 09:50:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 122.797492ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...............X......................] duration:
391.221575ms
FAIL (2025-08-11 09:50:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 391.244138ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X......X....................................] duration:
139.874649ms
FAIL (2025-08-11 09:50:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 139.897722ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X......X...................................] duration:
123.29887ms
FAIL (2025-08-11 09:50:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 123.371746ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X...............X.....................] duration:
435.599249ms
FAIL (2025-08-11 09:49:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 435.641736ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...............X....................] duration:
432.757113ms
FAIL (2025-08-11 09:49:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 432.800805ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X......X..................................] duration:
126.569231ms
FAIL (2025-08-11 09:48:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 126.60031ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X...............X...................] duration:
338.07335ms
FAIL (2025-08-11 09:48:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 338.09423ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...............X..................] duration:
477.150063ms
FAIL (2025-08-11 09:47:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 477.18068ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X......X.................................] duration:
142.662023ms
FAIL (2025-08-11 09:47:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 142.691127ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X...............X.................] duration:
381.768138ms
FAIL (2025-08-11 09:47:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 381.786703ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X...................X......X................................] duration:
147.774206ms
FAIL (2025-08-11 09:47:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 147.790737ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X...................X......X...............................] duration:
495.177744ms
FAIL (2025-08-11 09:46:33 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 495.201309ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...............X................] duration:
596.426568ms
FAIL (2025-08-11 09:46:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 596.447918ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X...............X...............] duration:
397.680884ms
FAIL (2025-08-11 09:45:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 397.718734ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X...................X......X..............................] duration:
485.613381ms
FAIL (2025-08-11 09:45:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 485.635292ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X...................X......X.............................] duration:
197.104311ms
FAIL (2025-08-11 09:44:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 197.122094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...............X..............] duration:
397.754402ms
FAIL (2025-08-11 09:44:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 397.808803ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X...................X......X............................] duration:
153.640154ms
FAIL (2025-08-11 09:44:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 153.659009ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X...............X.............] duration:
400.348856ms
FAIL (2025-08-11 09:43:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 400.368681ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X...................X......X...........................] duration:
412.583152ms
FAIL (2025-08-11 09:42:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 412.60276ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X...............X............] duration:
429.051603ms
FAIL (2025-08-11 09:42:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 429.076269ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X...................X......X..........................] duration:
403.338894ms
FAIL (2025-08-11 09:42:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 403.35865ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X...............X...........] duration:
422.848686ms
FAIL (2025-08-11 09:41:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 422.875165ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X...................X......X.........................] duration:
710.476279ms
FAIL (2025-08-11 09:41:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 710.499382ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X...............X..........] duration:
421.939118ms
FAIL (2025-08-11 09:40:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 421.969685ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X...................X......X........................] duration:
141.301134ms
FAIL (2025-08-11 09:40:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 141.328606ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...................X......X.......................] duration:
145.474523ms
FAIL (2025-08-11 09:39:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 145.4994ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X...............X.........] duration:
380.736102ms
FAIL (2025-08-11 09:39:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 380.767611ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X...............X........] duration:
358.448738ms
FAIL (2025-08-11 09:38:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 09:33:29.854874681 (64h7m10.586142341s) [upload=66738]: Starting upload Aug 11 09:33:29.854919956 (64h7m10.586187617s) [upload=66738]: Done starting upload Aug 11 09:33:29.855564900 (64h7m10.58683255s) [upload=66738]: Uploading segments... Aug 11 09:33:29.855605846 (64h7m10.586873497s) [upload=66738]: Got next segment. Inline: false Aug 11 09:33:29.855646813 (64h7m10.586914463s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 09:33:29.855651952 (64h7m10.586919602s) [upload=66738]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 09:33:29.869180727 (64h7m10.600448357s) [upload=66738]: Next segment err: metaclient: Too Many Requests Aug 11 09:33:29.869195374 (64h7m10.600463004s) [upload=66738]: Done uploading segments... Aug 11 09:33:29.869206726 (64h7m10.600474356s) [upload=66738]: Upload finished. err: metaclient: Too Many Requests
Duration: 358.463175ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...................X......X......................] duration:
155.611275ms
FAIL (2025-08-11 09:38:45 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 155.628105ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X...................X......X.....................] duration:
138.884902ms
FAIL (2025-08-11 09:38:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 11 09:21:53.116307660 (63h55m33.847575309s) [upload=66546]: Starting upload
Aug 11 09:21:53.116367111 (63h55m33.847634771s) [upload=66546]: Done starting upload
Aug 11 09:21:53.116448132 (63h55m33.847715782s) [upload=66546]: Uploading segments...
Aug 11 09:21:53.116487566 (63h55m33.847755216s) [upload=66546]: Got next segment. Inline: true
Aug 11 09:21:53.116492766 (63h55m33.847760415s) [upload=66546]: Waiting for error group managing segments...
Aug 11 09:21:53.116549912 (63h55m33.847817572s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 09:21:53.116555582 (63h55m33.847823233s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 11 09:21:53.116558979 (63h55m33.847826629s) [upload=66546]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 09:21:53.218862388 (63h55m33.950130037s) [upload=66546]: Done uploading segments...
Aug 11 09:21:53.218881563 (63h55m33.950149214s) [upload=66546]: Upload finished. err: <nil>
Duration: 138.904728ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|