Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.739247949s
FAIL (2025-08-22 03:52:12 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.739292964s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
496.886296ms
FAIL (2025-08-22 03:51:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 496.903828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.773585812s
FAIL (2025-08-22 03:51:30 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.773613155s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.797844523s
FAIL (2025-08-22 03:51:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.797865002s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.588185583s
FAIL (2025-08-22 03:51:05 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.58821592s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.308982794s
FAIL (2025-08-22 03:50:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.309013684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
4.916990756s
FAIL (2025-08-22 03:50:03 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 4.917017547s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.256747702s
FAIL (2025-08-22 03:49:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.256776085s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
6.392230646s
FAIL (2025-08-22 03:49:34 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 6.39225902s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
6.94928619s
FAIL (2025-08-22 03:48:42 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 6.949306749s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
374.251804ms
FAIL (2025-08-22 03:48:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 374.29208ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.552512347s
FAIL (2025-08-22 03:47:39 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.552541443s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.653373679s
FAIL (2025-08-22 03:47:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.653398575s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.585973633s
FAIL (2025-08-22 03:47:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.58606303s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.134674801s
FAIL (2025-08-22 03:46:35 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.134697585s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.331158224s
FAIL (2025-08-22 03:46:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.331182039s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
492.001983ms
FAIL (2025-08-22 03:45:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 492.020517ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
520.680255ms
FAIL (2025-08-22 03:45:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 520.705513ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.420723539s
FAIL (2025-08-22 03:45:52 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.42075058s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.784315734s
FAIL (2025-08-22 03:45:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.784333847s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
323.736658ms
FAIL (2025-08-22 03:45:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 323.759452ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
412.873795ms
FAIL (2025-08-22 03:45:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 412.894133ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
125.449301ms
FAIL (2025-08-22 03:44:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 125.472926ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
4.870084513s
FAIL (2025-08-22 03:44:47 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 4.870117084s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
168.7145ms
FAIL (2025-08-22 03:44:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.727906ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
9.680421142s
FAIL (2025-08-22 03:44:12 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 9.680441411s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.307941286s
FAIL (2025-08-22 03:44:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.307962305s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.414255439s
FAIL (2025-08-22 03:43:30 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.414279354s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
887.928655ms
FAIL (2025-08-22 03:43:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 887.95716ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
139.881939ms
FAIL (2025-08-22 03:43:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.900794ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
156.664211ms
FAIL (2025-08-22 03:43:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 156.690819ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.078840888s
FAIL (2025-08-22 03:42:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.078860164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
154.704189ms
FAIL (2025-08-22 03:42:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.73639ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.270314308s
FAIL (2025-08-22 03:42:33 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.270334177s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.443155196s
FAIL (2025-08-22 03:42:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.443173781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
746.472917ms
FAIL (2025-08-22 03:42:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 746.497382ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.195723053s
FAIL (2025-08-22 03:41:50 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.195749664s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
153.434901ms
FAIL (2025-08-22 03:41:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.456581ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.153735164s
FAIL (2025-08-22 03:41:28 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.153756043s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.456556576s
FAIL (2025-08-22 03:41:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.456578168s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
166.250357ms
FAIL (2025-08-22 03:41:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.275595ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.122744594s
FAIL (2025-08-22 03:41:06 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.122799096s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
8.633283746s
FAIL (2025-08-22 03:40:53 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 8.633308694s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
427.513843ms
FAIL (2025-08-22 03:40:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 427.542567ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.163454346s
FAIL (2025-08-22 03:40:25 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 5.163477831s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
390.451096ms
FAIL (2025-08-22 03:40:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 390.473377ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002102068s
FAIL (2025-08-22 03:39:50 UTC)
orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded
Duration: 30.002122818s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
134.877098ms
FAIL (2025-08-22 03:39:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.902273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
397.227864ms
FAIL (2025-08-22 03:39:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:33:12.065785480 (322h6m52.79705311s) [upload=334916]: Starting upload Aug 22 03:33:12.065835934 (322h6m52.797103564s) [upload=334916]: Done starting upload Aug 22 03:33:12.065983522 (322h6m52.797251173s) [upload=334916]: Uploading segments... Aug 22 03:33:12.066081026 (322h6m52.797348677s) [upload=334916]: Got next segment. Inline: false Aug 22 03:33:12.066144705 (322h6m52.797412356s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:33:12.066152590 (322h6m52.79742024s) [upload=334916]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 22 03:33:12.069128052 (322h6m52.800395722s) [upload=334916]: Next segment err: metaclient: Too Many Requests Aug 22 03:33:12.069226437 (322h6m52.800494097s) [upload=334916]: Done uploading segments... Aug 22 03:33:12.069253408 (322h6m52.800521058s) [upload=334916]: Upload finished. err: metaclient: Too Many Requests
Duration: 397.255897ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
161.742519ms
FAIL (2025-08-22 03:39:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 03:02:22.392435572 (321h36m3.123703232s) [upload=334376]: Starting upload Aug 22 03:02:22.392497078 (321h36m3.123764727s) [upload=334376]: Done starting upload Aug 22 03:02:22.392556550 (321h36m3.1238242s) [upload=334376]: Uploading segments... Aug 22 03:02:22.392655876 (321h36m3.123923526s) [upload=334376]: Got next segment. Inline: true Aug 22 03:02:22.392663782 (321h36m3.123931432s) [upload=334376]: Waiting for error group managing segments... Aug 22 03:02:22.392710970 (321h36m3.123978621s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 22 03:02:22.392717002 (321h36m3.123984652s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 22 03:02:22.392720468 (321h36m3.123988129s) [upload=334376]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 22 03:02:22.460947695 (321h36m3.192215344s) [upload=334376]: Done uploading segments... Aug 22 03:02:22.460971781 (321h36m3.19223944s) [upload=334376]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.795368ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|