Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.573189293s
FAIL (2025-08-25 17:17:55 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.573216293s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
14.30554061s
FAIL (2025-08-25 17:17:27 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 14.305575965s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
9.738551817s
FAIL (2025-08-25 17:16:39 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 9.738574931s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.524973336s
FAIL (2025-08-25 17:15:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.524998694s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.003500446s
FAIL (2025-08-25 17:15:17 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 30.003521936s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X.............................X....X......X...] duration:
628.548676ms
FAIL (2025-08-25 16:01:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:58:42.473828668 (406h32m23.205096318s) [upload=422645]: Starting upload Aug 25 15:58:42.473905753 (406h32m23.205173403s) [upload=422645]: Done starting upload Aug 25 15:58:42.474012364 (406h32m23.205279994s) [upload=422645]: Uploading segments... Aug 25 15:58:42.474309883 (406h32m23.205577543s) [upload=422645]: Got next segment. Inline: false Aug 25 15:58:42.474367911 (406h32m23.205635561s) [upload=422645]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:58:42.474373322 (406h32m23.205640971s) [upload=422645]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:58:42.477446449 (406h32m23.208714079s) [upload=422645]: Next segment err: metaclient: Too Many Requests Aug 25 15:58:42.477471577 (406h32m23.208739207s) [upload=422645]: Done uploading segments... Aug 25 15:58:42.477484811 (406h32m23.208752441s) [upload=422645]: Upload finished. err: metaclient: Too Many Requests
Duration: 628.571638ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
243.322849ms
FAIL (2025-08-25 16:01:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 243.352795ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
183.054818ms
FAIL (2025-08-25 16:00:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.08272ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X.............................X....X......X..] duration:
1.399704014s
FAIL (2025-08-25 16:00:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:58:42.473828668 (406h32m23.205096318s) [upload=422645]: Starting upload Aug 25 15:58:42.473905753 (406h32m23.205173403s) [upload=422645]: Done starting upload Aug 25 15:58:42.474012364 (406h32m23.205279994s) [upload=422645]: Uploading segments... Aug 25 15:58:42.474309883 (406h32m23.205577543s) [upload=422645]: Got next segment. Inline: false Aug 25 15:58:42.474367911 (406h32m23.205635561s) [upload=422645]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:58:42.474373322 (406h32m23.205640971s) [upload=422645]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:58:42.477446449 (406h32m23.208714079s) [upload=422645]: Next segment err: metaclient: Too Many Requests Aug 25 15:58:42.477471577 (406h32m23.208739207s) [upload=422645]: Done uploading segments... Aug 25 15:58:42.477484811 (406h32m23.208752441s) [upload=422645]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.399730103s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
465.332867ms
FAIL (2025-08-25 16:00:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 465.353526ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X.............................X....X......X.] duration:
1.214336464s
FAIL (2025-08-25 15:59:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:58:42.473828668 (406h32m23.205096318s) [upload=422645]: Starting upload Aug 25 15:58:42.473905753 (406h32m23.205173403s) [upload=422645]: Done starting upload Aug 25 15:58:42.474012364 (406h32m23.205279994s) [upload=422645]: Uploading segments... Aug 25 15:58:42.474309883 (406h32m23.205577543s) [upload=422645]: Got next segment. Inline: false Aug 25 15:58:42.474367911 (406h32m23.205635561s) [upload=422645]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:58:42.474373322 (406h32m23.205640971s) [upload=422645]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:58:42.477446449 (406h32m23.208714079s) [upload=422645]: Next segment err: metaclient: Too Many Requests Aug 25 15:58:42.477471577 (406h32m23.208739207s) [upload=422645]: Done uploading segments... Aug 25 15:58:42.477484811 (406h32m23.208752441s) [upload=422645]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.214358054s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
287.268581ms
FAIL (2025-08-25 15:59:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 287.290702ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
324.586533ms
FAIL (2025-08-25 15:59:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 324.604938ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X.............................X....X......X] duration:
26.888145ms
FAIL (2025-08-25 15:58:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:58:42.473828668 (406h32m23.205096318s) [upload=422645]: Starting upload Aug 25 15:58:42.473905753 (406h32m23.205173403s) [upload=422645]: Done starting upload Aug 25 15:58:42.474012364 (406h32m23.205279994s) [upload=422645]: Uploading segments... Aug 25 15:58:42.474309883 (406h32m23.205577543s) [upload=422645]: Got next segment. Inline: false Aug 25 15:58:42.474367911 (406h32m23.205635561s) [upload=422645]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:58:42.474373322 (406h32m23.205640971s) [upload=422645]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:58:42.477446449 (406h32m23.208714079s) [upload=422645]: Next segment err: metaclient: Too Many Requests Aug 25 15:58:42.477471577 (406h32m23.208739207s) [upload=422645]: Done uploading segments... Aug 25 15:58:42.477484811 (406h32m23.208752441s) [upload=422645]: Upload finished. err: metaclient: Too Many Requests
Duration: 26.908294ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
432.244945ms
FAIL (2025-08-25 15:58:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 432.262017ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.............................X....X......] duration:
1.530457423s
FAIL (2025-08-25 15:58:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:53:27.585551687 (406h27m8.316819337s) [upload=422548]: Starting upload Aug 25 15:53:27.585622530 (406h27m8.31689018s) [upload=422548]: Done starting upload Aug 25 15:53:27.585698824 (406h27m8.316966475s) [upload=422548]: Uploading segments... Aug 25 15:53:27.586027251 (406h27m8.317294911s) [upload=422548]: Got next segment. Inline: false Aug 25 15:53:27.586074991 (406h27m8.317342641s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:53:27.586080802 (406h27m8.317348452s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:53:27.588740884 (406h27m8.320008514s) [upload=422548]: Next segment err: metaclient: Too Many Requests Aug 25 15:53:27.588757945 (406h27m8.320025575s) [upload=422548]: Done uploading segments... Aug 25 15:53:27.588775609 (406h27m8.320043239s) [upload=422548]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.530478443s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
234.372502ms
FAIL (2025-08-25 15:57:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 234.402478ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X.............................X....X.....] duration:
1.934977011s
FAIL (2025-08-25 15:57:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:53:27.585551687 (406h27m8.316819337s) [upload=422548]: Starting upload Aug 25 15:53:27.585622530 (406h27m8.31689018s) [upload=422548]: Done starting upload Aug 25 15:53:27.585698824 (406h27m8.316966475s) [upload=422548]: Uploading segments... Aug 25 15:53:27.586027251 (406h27m8.317294911s) [upload=422548]: Got next segment. Inline: false Aug 25 15:53:27.586074991 (406h27m8.317342641s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:53:27.586080802 (406h27m8.317348452s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:53:27.588740884 (406h27m8.320008514s) [upload=422548]: Next segment err: metaclient: Too Many Requests Aug 25 15:53:27.588757945 (406h27m8.320025575s) [upload=422548]: Done uploading segments... Aug 25 15:53:27.588775609 (406h27m8.320043239s) [upload=422548]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.934998923s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X.............................X....X....] duration:
1.656202722s
FAIL (2025-08-25 15:57:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:53:27.585551687 (406h27m8.316819337s) [upload=422548]: Starting upload Aug 25 15:53:27.585622530 (406h27m8.31689018s) [upload=422548]: Done starting upload Aug 25 15:53:27.585698824 (406h27m8.316966475s) [upload=422548]: Uploading segments... Aug 25 15:53:27.586027251 (406h27m8.317294911s) [upload=422548]: Got next segment. Inline: false Aug 25 15:53:27.586074991 (406h27m8.317342641s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:53:27.586080802 (406h27m8.317348452s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:53:27.588740884 (406h27m8.320008514s) [upload=422548]: Next segment err: metaclient: Too Many Requests Aug 25 15:53:27.588757945 (406h27m8.320025575s) [upload=422548]: Done uploading segments... Aug 25 15:53:27.588775609 (406h27m8.320043239s) [upload=422548]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.656229001s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
210.812177ms
FAIL (2025-08-25 15:56:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 210.832856ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
197.688524ms
FAIL (2025-08-25 15:56:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 197.708542ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.............................X....X...] duration:
1.956570385s
FAIL (2025-08-25 15:56:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:53:27.585551687 (406h27m8.316819337s) [upload=422548]: Starting upload Aug 25 15:53:27.585622530 (406h27m8.31689018s) [upload=422548]: Done starting upload Aug 25 15:53:27.585698824 (406h27m8.316966475s) [upload=422548]: Uploading segments... Aug 25 15:53:27.586027251 (406h27m8.317294911s) [upload=422548]: Got next segment. Inline: false Aug 25 15:53:27.586074991 (406h27m8.317342641s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:53:27.586080802 (406h27m8.317348452s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:53:27.588740884 (406h27m8.320008514s) [upload=422548]: Next segment err: metaclient: Too Many Requests Aug 25 15:53:27.588757945 (406h27m8.320025575s) [upload=422548]: Done uploading segments... Aug 25 15:53:27.588775609 (406h27m8.320043239s) [upload=422548]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.956587808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
248.929856ms
FAIL (2025-08-25 15:55:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 248.950715ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
189.080032ms
FAIL (2025-08-25 15:55:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 189.11549ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X.............................X....X..] duration:
774.746412ms
FAIL (2025-08-25 15:54:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:53:27.585551687 (406h27m8.316819337s) [upload=422548]: Starting upload Aug 25 15:53:27.585622530 (406h27m8.31689018s) [upload=422548]: Done starting upload Aug 25 15:53:27.585698824 (406h27m8.316966475s) [upload=422548]: Uploading segments... Aug 25 15:53:27.586027251 (406h27m8.317294911s) [upload=422548]: Got next segment. Inline: false Aug 25 15:53:27.586074991 (406h27m8.317342641s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:53:27.586080802 (406h27m8.317348452s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:53:27.588740884 (406h27m8.320008514s) [upload=422548]: Next segment err: metaclient: Too Many Requests Aug 25 15:53:27.588757945 (406h27m8.320025575s) [upload=422548]: Done uploading segments... Aug 25 15:53:27.588775609 (406h27m8.320043239s) [upload=422548]: Upload finished. err: metaclient: Too Many Requests
Duration: 774.773453ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.............................X....X.] duration:
675.490088ms
FAIL (2025-08-25 15:54:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:53:27.585551687 (406h27m8.316819337s) [upload=422548]: Starting upload Aug 25 15:53:27.585622530 (406h27m8.31689018s) [upload=422548]: Done starting upload Aug 25 15:53:27.585698824 (406h27m8.316966475s) [upload=422548]: Uploading segments... Aug 25 15:53:27.586027251 (406h27m8.317294911s) [upload=422548]: Got next segment. Inline: false Aug 25 15:53:27.586074991 (406h27m8.317342641s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:53:27.586080802 (406h27m8.317348452s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:53:27.588740884 (406h27m8.320008514s) [upload=422548]: Next segment err: metaclient: Too Many Requests Aug 25 15:53:27.588757945 (406h27m8.320025575s) [upload=422548]: Done uploading segments... Aug 25 15:53:27.588775609 (406h27m8.320043239s) [upload=422548]: Upload finished. err: metaclient: Too Many Requests
Duration: 675.516457ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
392.385234ms
FAIL (2025-08-25 15:54:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 392.437402ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
190.514409ms
FAIL (2025-08-25 15:53:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 190.537613ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
506.632912ms
FAIL (2025-08-25 15:53:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 506.657908ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X.............................X....X] duration:
17.758366ms
FAIL (2025-08-25 15:53:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:53:27.585551687 (406h27m8.316819337s) [upload=422548]: Starting upload Aug 25 15:53:27.585622530 (406h27m8.31689018s) [upload=422548]: Done starting upload Aug 25 15:53:27.585698824 (406h27m8.316966475s) [upload=422548]: Uploading segments... Aug 25 15:53:27.586027251 (406h27m8.317294911s) [upload=422548]: Got next segment. Inline: false Aug 25 15:53:27.586074991 (406h27m8.317342641s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:53:27.586080802 (406h27m8.317348452s) [upload=422548]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:53:27.588740884 (406h27m8.320008514s) [upload=422548]: Next segment err: metaclient: Too Many Requests Aug 25 15:53:27.588757945 (406h27m8.320025575s) [upload=422548]: Done uploading segments... Aug 25 15:53:27.588775609 (406h27m8.320043239s) [upload=422548]: Upload finished. err: metaclient: Too Many Requests
Duration: 17.789535ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
393.551568ms
FAIL (2025-08-25 15:53:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 393.57911ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
646.780004ms
FAIL (2025-08-25 15:52:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 646.802166ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.............................X....] duration:
1.645089908s
FAIL (2025-08-25 15:52:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:50:59.927408124 (406h24m40.658675784s) [upload=422497]: Starting upload Aug 25 15:50:59.927495248 (406h24m40.658762908s) [upload=422497]: Done starting upload Aug 25 15:50:59.927617968 (406h24m40.658885618s) [upload=422497]: Uploading segments... Aug 25 15:50:59.928020695 (406h24m40.659288355s) [upload=422497]: Got next segment. Inline: false Aug 25 15:50:59.928068164 (406h24m40.659335825s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:50:59.928074647 (406h24m40.659342297s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:50:59.931270455 (406h24m40.662538104s) [upload=422497]: Next segment err: metaclient: Too Many Requests Aug 25 15:50:59.931287907 (406h24m40.662555557s) [upload=422497]: Done uploading segments... Aug 25 15:50:59.931301973 (406h24m40.662569624s) [upload=422497]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.645113582s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
287.435074ms
FAIL (2025-08-25 15:52:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 287.452596ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.............................X...] duration:
999.58445ms
FAIL (2025-08-25 15:52:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:50:59.927408124 (406h24m40.658675784s) [upload=422497]: Starting upload Aug 25 15:50:59.927495248 (406h24m40.658762908s) [upload=422497]: Done starting upload Aug 25 15:50:59.927617968 (406h24m40.658885618s) [upload=422497]: Uploading segments... Aug 25 15:50:59.928020695 (406h24m40.659288355s) [upload=422497]: Got next segment. Inline: false Aug 25 15:50:59.928068164 (406h24m40.659335825s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:50:59.928074647 (406h24m40.659342297s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:50:59.931270455 (406h24m40.662538104s) [upload=422497]: Next segment err: metaclient: Too Many Requests Aug 25 15:50:59.931287907 (406h24m40.662555557s) [upload=422497]: Done uploading segments... Aug 25 15:50:59.931301973 (406h24m40.662569624s) [upload=422497]: Upload finished. err: metaclient: Too Many Requests
Duration: 999.606531ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.............................X..] duration:
3.648826395s
FAIL (2025-08-25 15:51:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:50:59.927408124 (406h24m40.658675784s) [upload=422497]: Starting upload Aug 25 15:50:59.927495248 (406h24m40.658762908s) [upload=422497]: Done starting upload Aug 25 15:50:59.927617968 (406h24m40.658885618s) [upload=422497]: Uploading segments... Aug 25 15:50:59.928020695 (406h24m40.659288355s) [upload=422497]: Got next segment. Inline: false Aug 25 15:50:59.928068164 (406h24m40.659335825s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:50:59.928074647 (406h24m40.659342297s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:50:59.931270455 (406h24m40.662538104s) [upload=422497]: Next segment err: metaclient: Too Many Requests Aug 25 15:50:59.931287907 (406h24m40.662555557s) [upload=422497]: Done uploading segments... Aug 25 15:50:59.931301973 (406h24m40.662569624s) [upload=422497]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.64885049s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X.............................X.] duration:
3.431571118s
FAIL (2025-08-25 15:51:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:50:59.927408124 (406h24m40.658675784s) [upload=422497]: Starting upload Aug 25 15:50:59.927495248 (406h24m40.658762908s) [upload=422497]: Done starting upload Aug 25 15:50:59.927617968 (406h24m40.658885618s) [upload=422497]: Uploading segments... Aug 25 15:50:59.928020695 (406h24m40.659288355s) [upload=422497]: Got next segment. Inline: false Aug 25 15:50:59.928068164 (406h24m40.659335825s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:50:59.928074647 (406h24m40.659342297s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:50:59.931270455 (406h24m40.662538104s) [upload=422497]: Next segment err: metaclient: Too Many Requests Aug 25 15:50:59.931287907 (406h24m40.662555557s) [upload=422497]: Done uploading segments... Aug 25 15:50:59.931301973 (406h24m40.662569624s) [upload=422497]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.431602337s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
329.853378ms
FAIL (2025-08-25 15:51:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 329.877012ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.............................X] duration:
19.110176ms
FAIL (2025-08-25 15:50:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:50:59.927408124 (406h24m40.658675784s) [upload=422497]: Starting upload Aug 25 15:50:59.927495248 (406h24m40.658762908s) [upload=422497]: Done starting upload Aug 25 15:50:59.927617968 (406h24m40.658885618s) [upload=422497]: Uploading segments... Aug 25 15:50:59.928020695 (406h24m40.659288355s) [upload=422497]: Got next segment. Inline: false Aug 25 15:50:59.928068164 (406h24m40.659335825s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:50:59.928074647 (406h24m40.659342297s) [upload=422497]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:50:59.931270455 (406h24m40.662538104s) [upload=422497]: Next segment err: metaclient: Too Many Requests Aug 25 15:50:59.931287907 (406h24m40.662555557s) [upload=422497]: Done uploading segments... Aug 25 15:50:59.931301973 (406h24m40.662569624s) [upload=422497]: Upload finished. err: metaclient: Too Many Requests
Duration: 19.13389ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
636.098583ms
FAIL (2025-08-25 15:50:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 636.127348ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.110950581s
FAIL (2025-08-25 15:50:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:33.605311465 (406h2m14.336579085s) [upload=422106]: Starting upload Aug 25 15:28:33.605358824 (406h2m14.336626454s) [upload=422106]: Done starting upload Aug 25 15:28:33.605431610 (406h2m14.336699231s) [upload=422106]: Uploading segments... Aug 25 15:28:33.605633841 (406h2m14.336901471s) [upload=422106]: Got next segment. Inline: false Aug 25 15:28:33.605690126 (406h2m14.336957787s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:33.605696108 (406h2m14.336963738s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:28:33.608665590 (406h2m14.33993322s) [upload=422106]: Next segment err: metaclient: Too Many Requests Aug 25 15:28:33.608677693 (406h2m14.339945313s) [upload=422106]: Done uploading segments... Aug 25 15:28:33.608687451 (406h2m14.339955081s) [upload=422106]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.110970067s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
238.641482ms
FAIL (2025-08-25 15:49:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 238.662671ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
709.029001ms
FAIL (2025-08-25 15:49:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:33.605311465 (406h2m14.336579085s) [upload=422106]: Starting upload Aug 25 15:28:33.605358824 (406h2m14.336626454s) [upload=422106]: Done starting upload Aug 25 15:28:33.605431610 (406h2m14.336699231s) [upload=422106]: Uploading segments... Aug 25 15:28:33.605633841 (406h2m14.336901471s) [upload=422106]: Got next segment. Inline: false Aug 25 15:28:33.605690126 (406h2m14.336957787s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:33.605696108 (406h2m14.336963738s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:28:33.608665590 (406h2m14.33993322s) [upload=422106]: Next segment err: metaclient: Too Many Requests Aug 25 15:28:33.608677693 (406h2m14.339945313s) [upload=422106]: Done uploading segments... Aug 25 15:28:33.608687451 (406h2m14.339955081s) [upload=422106]: Upload finished. err: metaclient: Too Many Requests
Duration: 709.060279ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.847201789s
FAIL (2025-08-25 15:49:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:33.605311465 (406h2m14.336579085s) [upload=422106]: Starting upload Aug 25 15:28:33.605358824 (406h2m14.336626454s) [upload=422106]: Done starting upload Aug 25 15:28:33.605431610 (406h2m14.336699231s) [upload=422106]: Uploading segments... Aug 25 15:28:33.605633841 (406h2m14.336901471s) [upload=422106]: Got next segment. Inline: false Aug 25 15:28:33.605690126 (406h2m14.336957787s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:33.605696108 (406h2m14.336963738s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:28:33.608665590 (406h2m14.33993322s) [upload=422106]: Next segment err: metaclient: Too Many Requests Aug 25 15:28:33.608677693 (406h2m14.339945313s) [upload=422106]: Done uploading segments... Aug 25 15:28:33.608687451 (406h2m14.339955081s) [upload=422106]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.847227337s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
141.735205ms
FAIL (2025-08-25 15:48:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 141.756796ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.665940156s
FAIL (2025-08-25 15:48:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:33.605311465 (406h2m14.336579085s) [upload=422106]: Starting upload Aug 25 15:28:33.605358824 (406h2m14.336626454s) [upload=422106]: Done starting upload Aug 25 15:28:33.605431610 (406h2m14.336699231s) [upload=422106]: Uploading segments... Aug 25 15:28:33.605633841 (406h2m14.336901471s) [upload=422106]: Got next segment. Inline: false Aug 25 15:28:33.605690126 (406h2m14.336957787s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:33.605696108 (406h2m14.336963738s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:28:33.608665590 (406h2m14.33993322s) [upload=422106]: Next segment err: metaclient: Too Many Requests Aug 25 15:28:33.608677693 (406h2m14.339945313s) [upload=422106]: Done uploading segments... Aug 25 15:28:33.608687451 (406h2m14.339955081s) [upload=422106]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.66597436s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
579.71125ms
FAIL (2025-08-25 15:47:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 579.782824ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
8.663022984s
FAIL (2025-08-25 15:47:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 8.663045156s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.456507935s
FAIL (2025-08-25 15:47:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:33.605311465 (406h2m14.336579085s) [upload=422106]: Starting upload Aug 25 15:28:33.605358824 (406h2m14.336626454s) [upload=422106]: Done starting upload Aug 25 15:28:33.605431610 (406h2m14.336699231s) [upload=422106]: Uploading segments... Aug 25 15:28:33.605633841 (406h2m14.336901471s) [upload=422106]: Got next segment. Inline: false Aug 25 15:28:33.605690126 (406h2m14.336957787s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:33.605696108 (406h2m14.336963738s) [upload=422106]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 15:28:33.608665590 (406h2m14.33993322s) [upload=422106]: Next segment err: metaclient: Too Many Requests Aug 25 15:28:33.608677693 (406h2m14.339945313s) [upload=422106]: Done uploading segments... Aug 25 15:28:33.608687451 (406h2m14.339955081s) [upload=422106]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.456591622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
191.600779ms
FAIL (2025-08-25 15:46:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 15:28:16.908063125 (406h1m57.639330776s) [upload=422103]: Starting upload Aug 25 15:28:16.908135511 (406h1m57.639403161s) [upload=422103]: Done starting upload Aug 25 15:28:16.908217355 (406h1m57.639485005s) [upload=422103]: Uploading segments... Aug 25 15:28:16.908285694 (406h1m57.639553344s) [upload=422103]: Got next segment. Inline: true Aug 25 15:28:16.908296444 (406h1m57.639564104s) [upload=422103]: Waiting for error group managing segments... Aug 25 15:28:16.908364812 (406h1m57.639632463s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 15:28:16.908371033 (406h1m57.639638684s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 15:28:16.908374971 (406h1m57.639642621s) [upload=422103]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 15:28:16.910518109 (406h1m57.64178575s) [upload=422103]: Done uploading segments... Aug 25 15:28:16.910535432 (406h1m57.641803082s) [upload=422103]: Upload finished. err: metaclient: Too Many Requests
Duration: 191.619555ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|