Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
4.926359422s
FAIL (2025-08-18 19:24:32 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.926407261s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
461.710051ms
FAIL (2025-08-18 19:24:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 461.741511ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
769.352422ms
FAIL (2025-08-18 19:24:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 19:24:03.519559090 (241h57m44.250826741s) [upload=251679]: Starting upload Aug 18 19:24:03.519624024 (241h57m44.250891673s) [upload=251679]: Done starting upload Aug 18 19:24:03.520042570 (241h57m44.251310219s) [upload=251679]: Uploading segments... Aug 18 19:24:03.520088636 (241h57m44.251356286s) [upload=251679]: Got next segment. Inline: false Aug 18 19:24:03.520125485 (241h57m44.251393135s) [upload=251679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 19:24:03.520130684 (241h57m44.251398335s) [upload=251679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 19:24:03.522973084 (241h57m44.254240733s) [upload=251679]: Next segment err: metaclient: Too Many Requests Aug 18 19:24:03.522989815 (241h57m44.254257465s) [upload=251679]: Done uploading segments... Aug 18 19:24:03.523003060 (241h57m44.25427072s) [upload=251679]: Upload finished. err: metaclient: Too Many Requests
Duration: 769.373672ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
17.62243ms
FAIL (2025-08-18 19:24:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 19:24:03.519559090 (241h57m44.250826741s) [upload=251679]: Starting upload Aug 18 19:24:03.519624024 (241h57m44.250891673s) [upload=251679]: Done starting upload Aug 18 19:24:03.520042570 (241h57m44.251310219s) [upload=251679]: Uploading segments... Aug 18 19:24:03.520088636 (241h57m44.251356286s) [upload=251679]: Got next segment. Inline: false Aug 18 19:24:03.520125485 (241h57m44.251393135s) [upload=251679]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 19:24:03.520130684 (241h57m44.251398335s) [upload=251679]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 19:24:03.522973084 (241h57m44.254240733s) [upload=251679]: Next segment err: metaclient: Too Many Requests Aug 18 19:24:03.522989815 (241h57m44.254257465s) [upload=251679]: Done uploading segments... Aug 18 19:24:03.523003060 (241h57m44.25427072s) [upload=251679]: Upload finished. err: metaclient: Too Many Requests
Duration: 17.650523ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.201655556s
FAIL (2025-08-18 19:23:31 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.201675584s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
479.099726ms
FAIL (2025-08-18 19:23:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 479.116396ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
4.936519085s
FAIL (2025-08-18 19:23:03 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.936565472s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
216.455358ms
FAIL (2025-08-18 19:22:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 216.482038ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.062430494s
FAIL (2025-08-18 19:22:11 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.062456812s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
4.973100488s
FAIL (2025-08-18 19:21:50 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.973115247s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
605.215202ms
FAIL (2025-08-18 19:21:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 605.243113ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
126.938411ms
FAIL (2025-08-18 19:21:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 126.962386ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
448.82609ms
FAIL (2025-08-18 19:21:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 448.84676ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
147.722079ms
FAIL (2025-08-18 19:21:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 147.74912ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.469850117s
FAIL (2025-08-18 19:20:40 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.469881727s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
713.892359ms
FAIL (2025-08-18 19:20:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 713.911124ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
679.886613ms
FAIL (2025-08-18 19:20:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 679.919685ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
122.071699ms
FAIL (2025-08-18 19:19:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 122.092448ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
6.762505912s
FAIL (2025-08-18 19:19:45 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 6.762527092s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
541.487123ms
FAIL (2025-08-18 19:19:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 541.516047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
425.34351ms
FAIL (2025-08-18 19:18:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 425.363287ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
7.566179588s
FAIL (2025-08-18 19:18:53 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 7.566201829s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
726.316496ms
FAIL (2025-08-18 19:18:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 726.338828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.027452076s
FAIL (2025-08-18 19:18:24 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.027478026s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
505.571588ms
FAIL (2025-08-18 19:17:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 505.599631ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
7.670606026s
FAIL (2025-08-18 19:17:18 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 7.670630863s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
427.866345ms
FAIL (2025-08-18 19:17:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 427.88478ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.025864886s
FAIL (2025-08-18 19:16:52 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.025913928s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
7.35435174s
FAIL (2025-08-18 19:16:06 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 7.354373702s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
476.726356ms
FAIL (2025-08-18 19:16:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 476.745262ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................] duration:
920.396683ms
FAIL (2025-08-18 19:15:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 920.435785ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.004283442s
FAIL (2025-08-18 19:15:32 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 6.004312326s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
8.119083348s
FAIL (2025-08-18 19:14:28 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 8.119099888s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X........XX.................................................] duration:
501.077746ms
FAIL (2025-08-18 19:14:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 501.092524ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X........XX................................................] duration:
1.515615974s
FAIL (2025-08-18 19:13:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.515635351s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.056264327s
FAIL (2025-08-18 19:13:35 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.056286309s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
17.374563413s
FAIL (2025-08-18 19:12:59 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 17.374628246s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X........XX...............................................] duration:
474.190122ms
FAIL (2025-08-18 19:12:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 474.233003ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X........XX..............................................] duration:
445.25994ms
FAIL (2025-08-18 19:12:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 445.293204ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.19677494s
FAIL (2025-08-18 19:12:10 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.19679607s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.432897254s
FAIL (2025-08-18 19:11:51 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 6.432924174s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X........XX.............................................] duration:
381.472036ms
FAIL (2025-08-18 19:11:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 381.497123ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X........XX............................................] duration:
594.072042ms
FAIL (2025-08-18 19:10:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 594.096268ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
10.071425965s
FAIL (2025-08-18 19:10:49 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 10.071446945s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.243631916s
FAIL (2025-08-18 19:10:23 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 6.243654809s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X........XX...........................................] duration:
583.371664ms
FAIL (2025-08-18 19:10:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 583.391933ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
26.33007675s
FAIL (2025-08-18 19:10:03 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 26.330132073s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
8.783036753s
FAIL (2025-08-18 19:09:21 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 8.783064075s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X........XX..........................................] duration:
520.771231ms
FAIL (2025-08-18 19:09:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 520.794094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X........XX.........................................] duration:
508.44363ms
FAIL (2025-08-18 19:08:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 508.467364ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|