Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
480.314658ms
FAIL (2025-08-22 16:28:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 480.33133ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X..........................X..........................] duration:
1.139713455s
FAIL (2025-08-22 16:27:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.139734927s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
267.811744ms
FAIL (2025-08-22 16:27:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 267.830899ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
210.373626ms
FAIL (2025-08-22 16:27:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 210.392872ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..........................X.........................] duration:
1.782605322s
FAIL (2025-08-22 16:27:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.782630009s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
240.187398ms
FAIL (2025-08-22 16:26:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 240.283027ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
231.587338ms
FAIL (2025-08-22 16:25:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 231.610301ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.......X..........................X........................] duration:
780.69153ms
FAIL (2025-08-22 16:25:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 780.711677ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
370.068511ms
FAIL (2025-08-22 16:24:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 370.143091ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.......X..........................X.......................] duration:
443.081832ms
FAIL (2025-08-22 16:24:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 443.100588ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
227.133992ms
FAIL (2025-08-22 16:24:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 227.160891ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
394.103088ms
FAIL (2025-08-22 16:23:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 394.127042ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.......X..........................X......................] duration:
1.735753807s
FAIL (2025-08-22 16:23:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.735779876s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
544.65751ms
FAIL (2025-08-22 16:23:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 544.680774ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
140.371801ms
FAIL (2025-08-22 16:22:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 140.388421ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.......X..........................X.....................] duration:
1.967795866s
FAIL (2025-08-22 16:22:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.967822725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
255.951695ms
FAIL (2025-08-22 16:22:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 255.967655ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
183.941576ms
FAIL (2025-08-22 16:21:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 183.963527ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.......X..........................X....................] duration:
495.216876ms
FAIL (2025-08-22 16:21:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 495.234769ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
169.121326ms
FAIL (2025-08-22 16:21:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 169.142245ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
501.620778ms
FAIL (2025-08-22 16:20:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 501.641146ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.......X..........................X...................] duration:
1.11252518s
FAIL (2025-08-22 16:20:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.112542784s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
456.03048ms
FAIL (2025-08-22 16:19:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 456.055507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.......X..........................X..................] duration:
1.68074319s
FAIL (2025-08-22 16:19:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.680790769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
153.838113ms
FAIL (2025-08-22 16:19:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 153.865265ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.......X..........................X.................] duration:
1.695556448s
FAIL (2025-08-22 16:18:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.695584081s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
150.384894ms
FAIL (2025-08-22 16:18:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 150.403409ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.......X..........................X................] duration:
1.431313279s
FAIL (2025-08-22 16:17:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.431337565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
528.817269ms
FAIL (2025-08-22 16:17:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 528.841425ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
415.759674ms
FAIL (2025-08-22 16:16:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 415.782346ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.......X..........................X...............] duration:
797.017807ms
FAIL (2025-08-22 16:16:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 797.065686ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.......X..........................X..............] duration:
1.73628152s
FAIL (2025-08-22 16:16:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.736303631s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
756.788377ms
FAIL (2025-08-22 16:16:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 756.81108ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.......X..........................X.............] duration:
1.43710506s
FAIL (2025-08-22 16:15:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.437130708s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
143.691698ms
FAIL (2025-08-22 16:15:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 143.727526ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
483.876314ms
FAIL (2025-08-22 16:14:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 483.898075ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.......X..........................X............] duration:
518.317451ms
FAIL (2025-08-22 16:14:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 518.341977ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.......X..........................X...........] duration:
1.693359905s
FAIL (2025-08-22 16:14:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.693382888s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
483.809888ms
FAIL (2025-08-22 16:13:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 483.86423ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.......X..........................X..........] duration:
1.197438311s
FAIL (2025-08-22 16:13:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.197462467s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
251.810371ms
FAIL (2025-08-22 16:13:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 22 16:13:04.534151296 (334h46m45.265418916s) [upload=348016]: Starting upload
Aug 22 16:13:04.534195881 (334h46m45.265463511s) [upload=348016]: Done starting upload
Aug 22 16:13:04.534255813 (334h46m45.265523443s) [upload=348016]: Uploading segments...
Aug 22 16:13:04.534291451 (334h46m45.265559081s) [upload=348016]: Got next segment. Inline: true
Aug 22 16:13:04.534297382 (334h46m45.265565012s) [upload=348016]: Waiting for error group managing segments...
Aug 22 16:13:04.534337347 (334h46m45.265604968s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 22 16:13:04.534344190 (334h46m45.265611821s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 22 16:13:04.534348187 (334h46m45.265615817s) [upload=348016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 22 16:13:04.647712782 (334h46m45.378980402s) [upload=348016]: Done uploading segments...
Aug 22 16:13:04.647726547 (334h46m45.378994178s) [upload=348016]: Upload finished. err: <nil>
Duration: 251.840818ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.......X..........................X.........] duration:
1.180648686s
FAIL (2025-08-22 16:12:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.18066722s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.......X..........................X........] duration:
445.03094ms
FAIL (2025-08-22 16:12:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 445.060575ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.......X..........................X.......] duration:
1.806830428s
FAIL (2025-08-22 16:10:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.806853682s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.......X..........................X......] duration:
833.957815ms
FAIL (2025-08-22 16:10:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.980188ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X.......X..........................X.....] duration:
1.326539382s
FAIL (2025-08-22 16:09:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.32655972s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X.......X..........................X....] duration:
1.005541385s
FAIL (2025-08-22 16:08:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.005612658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
3.09649098s
FAIL (2025-08-22 16:07:08 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.096513984s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.......X..........................X...] duration:
570.77359ms
FAIL (2025-08-22 16:06:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 16:05:04.105829932 (334h38m44.837097551s) [upload=347874]: Starting upload Aug 22 16:05:04.105868214 (334h38m44.837135834s) [upload=347874]: Done starting upload Aug 22 16:05:04.105939467 (334h38m44.837207087s) [upload=347874]: Uploading segments... Aug 22 16:05:04.106554155 (334h38m44.837821785s) [upload=347874]: Got next segment. Inline: false Aug 22 16:05:04.106583289 (334h38m44.83785092s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 16:05:04.106586957 (334h38m44.837854576s) [upload=347874]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 16:05:04.109248467 (334h38m44.840516097s) [upload=347874]: Next segment err: metaclient: Too Many Requests Aug 22 16:05:04.109259698 (334h38m44.840527318s) [upload=347874]: Done uploading segments... Aug 22 16:05:04.109268184 (334h38m44.840535814s) [upload=347874]: Upload finished. err: metaclient: Too Many Requests
Duration: 570.795571ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
3.00666136s
FAIL (2025-08-22 16:06:15 UTC)
orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded
Duration: 3.006681468s
core
uplink
eu1
|