Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
216.455358ms
FAIL (2025-08-18 19:22:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 216.482038ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.062430494s
FAIL (2025-08-18 19:22:11 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.062456812s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
4.973100488s
FAIL (2025-08-18 19:21:50 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 4.973115247s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
605.215202ms
FAIL (2025-08-18 19:21:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 605.243113ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
126.938411ms
FAIL (2025-08-18 19:21:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 126.962386ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
448.82609ms
FAIL (2025-08-18 19:21:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 448.84676ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
147.722079ms
FAIL (2025-08-18 19:21:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 147.74912ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.469850117s
FAIL (2025-08-18 19:20:40 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.469881727s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
713.892359ms
FAIL (2025-08-18 19:20:21 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 713.911124ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
679.886613ms
FAIL (2025-08-18 19:20:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 679.919685ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
122.071699ms
FAIL (2025-08-18 19:19:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 18 19:19:53.245604846 (241h53m33.976872476s) [upload=251607]: Starting upload
Aug 18 19:19:53.245641095 (241h53m33.976908725s) [upload=251607]: Done starting upload
Aug 18 19:19:53.245687692 (241h53m33.976955312s) [upload=251607]: Uploading segments...
Aug 18 19:19:53.245717848 (241h53m33.976985469s) [upload=251607]: Got next segment. Inline: true
Aug 18 19:19:53.245721615 (241h53m33.976989236s) [upload=251607]: Waiting for error group managing segments...
Aug 18 19:19:53.245754928 (241h53m33.977022558s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 19:19:53.245758485 (241h53m33.977026105s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 18 19:19:53.245760839 (241h53m33.977028469s) [upload=251607]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 19:19:53.323155687 (241h53m34.054423346s) [upload=251607]: Done uploading segments...
Aug 18 19:19:53.323173189 (241h53m34.054440839s) [upload=251607]: Upload finished. err: <nil>
Duration: 122.092448ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
6.762505912s
FAIL (2025-08-18 19:19:45 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 6.762527092s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
541.487123ms
FAIL (2025-08-18 19:19:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 541.516047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
425.34351ms
FAIL (2025-08-18 19:18:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 425.363287ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
7.566179588s
FAIL (2025-08-18 19:18:53 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 7.566201829s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................] duration:
726.316496ms
FAIL (2025-08-18 19:18:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 726.338828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.027452076s
FAIL (2025-08-18 19:18:24 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.027478026s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration:
505.571588ms
FAIL (2025-08-18 19:17:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 505.599631ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
7.670606026s
FAIL (2025-08-18 19:17:18 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 7.670630863s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................] duration:
427.866345ms
FAIL (2025-08-18 19:17:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 427.88478ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.025864886s
FAIL (2025-08-18 19:16:52 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.025913928s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
7.35435174s
FAIL (2025-08-18 19:16:06 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 7.354373702s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................] duration:
476.726356ms
FAIL (2025-08-18 19:16:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 476.745262ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................] duration:
920.396683ms
FAIL (2025-08-18 19:15:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 920.435785ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
6.004283442s
FAIL (2025-08-18 19:15:32 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 6.004312326s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
8.119083348s
FAIL (2025-08-18 19:14:28 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 8.119099888s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X........XX.................................................] duration:
501.077746ms
FAIL (2025-08-18 19:14:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 501.092524ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X........XX................................................] duration:
1.515615974s
FAIL (2025-08-18 19:13:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.515635351s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.056264327s
FAIL (2025-08-18 19:13:35 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.056286309s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
17.374563413s
FAIL (2025-08-18 19:12:59 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 17.374628246s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X........XX...............................................] duration:
474.190122ms
FAIL (2025-08-18 19:12:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 474.233003ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X........XX..............................................] duration:
445.25994ms
FAIL (2025-08-18 19:12:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 445.293204ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.19677494s
FAIL (2025-08-18 19:12:10 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 5.19679607s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.432897254s
FAIL (2025-08-18 19:11:51 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 6.432924174s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X........XX.............................................] duration:
381.472036ms
FAIL (2025-08-18 19:11:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 381.497123ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X........XX............................................] duration:
594.072042ms
FAIL (2025-08-18 19:10:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 594.096268ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
10.071425965s
FAIL (2025-08-18 19:10:49 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 10.071446945s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.243631916s
FAIL (2025-08-18 19:10:23 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 6.243654809s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X........XX...........................................] duration:
583.371664ms
FAIL (2025-08-18 19:10:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 583.391933ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
26.33007675s
FAIL (2025-08-18 19:10:03 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 26.330132073s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
8.783036753s
FAIL (2025-08-18 19:09:21 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 8.783064075s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X........XX..........................................] duration:
520.771231ms
FAIL (2025-08-18 19:09:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 520.794094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X........XX.........................................] duration:
508.44363ms
FAIL (2025-08-18 19:08:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 508.467364ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X........XX........................................] duration:
643.868309ms
FAIL (2025-08-18 19:08:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 643.887956ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
11.037574537s
FAIL (2025-08-18 19:08:19 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 11.037593282s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X........XX.......................................] duration:
648.199564ms
FAIL (2025-08-18 19:07:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 648.220234ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X........XX......................................] duration:
592.5746ms
FAIL (2025-08-18 19:07:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 592.593777ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
11.2415433s
FAIL (2025-08-18 19:07:33 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 11.241567516s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X........XX.....................................] duration:
490.637308ms
FAIL (2025-08-18 19:07:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:40:06.436576499 (241h13m47.167844129s) [upload=250909]: Starting upload Aug 18 18:40:06.436620081 (241h13m47.167887711s) [upload=250909]: Done starting upload Aug 18 18:40:06.436671939 (241h13m47.167939569s) [upload=250909]: Uploading segments... Aug 18 18:40:06.436854662 (241h13m47.168122282s) [upload=250909]: Got next segment. Inline: false Aug 18 18:40:06.436892353 (241h13m47.168159983s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:40:06.436896911 (241h13m47.168164541s) [upload=250909]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:40:06.439793444 (241h13m47.171061074s) [upload=250909]: Next segment err: metaclient: Too Many Requests Aug 18 18:40:06.439806297 (241h13m47.171073927s) [upload=250909]: Done uploading segments... Aug 18 18:40:06.439823239 (241h13m47.171090859s) [upload=250909]: Upload finished. err: metaclient: Too Many Requests
Duration: 490.665071ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.004819687s
FAIL (2025-08-18 19:06:44 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 30.004839743s
core
uplink
ap1
|