Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X.......X.................] duration:
138.334012ms
FAIL (2025-08-21 04:36:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 138.367725ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
383.608121ms
FAIL (2025-08-21 04:36:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:34:24.881978263 (299h8m5.613246003s) [upload=311028]: Starting upload Aug 21 04:34:24.882061829 (299h8m5.613329459s) [upload=311028]: Done starting upload Aug 21 04:34:24.882169603 (299h8m5.613437222s) [upload=311028]: Uploading segments... Aug 21 04:34:24.882374318 (299h8m5.613641948s) [upload=311028]: Got next segment. Inline: false Aug 21 04:34:24.882403101 (299h8m5.613670731s) [upload=311028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:34:24.882407009 (299h8m5.613674639s) [upload=311028]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:34:24.884995262 (299h8m5.616262892s) [upload=311028]: Next segment err: metaclient: Too Many Requests Aug 21 04:34:24.885013566 (299h8m5.616281196s) [upload=311028]: Done uploading segments... Aug 21 04:34:24.885023846 (299h8m5.616291465s) [upload=311028]: Upload finished. err: metaclient: Too Many Requests
Duration: 383.62923ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X.......X................] duration:
169.443067ms
FAIL (2025-08-21 04:35:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 169.517497ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.093080636s
FAIL (2025-08-21 04:35:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:34:24.881978263 (299h8m5.613246003s) [upload=311028]: Starting upload Aug 21 04:34:24.882061829 (299h8m5.613329459s) [upload=311028]: Done starting upload Aug 21 04:34:24.882169603 (299h8m5.613437222s) [upload=311028]: Uploading segments... Aug 21 04:34:24.882374318 (299h8m5.613641948s) [upload=311028]: Got next segment. Inline: false Aug 21 04:34:24.882403101 (299h8m5.613670731s) [upload=311028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:34:24.882407009 (299h8m5.613674639s) [upload=311028]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:34:24.884995262 (299h8m5.616262892s) [upload=311028]: Next segment err: metaclient: Too Many Requests Aug 21 04:34:24.885013566 (299h8m5.616281196s) [upload=311028]: Done uploading segments... Aug 21 04:34:24.885023846 (299h8m5.616291465s) [upload=311028]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.093103138s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X.......X...............] duration:
149.954707ms
FAIL (2025-08-21 04:35:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.99957ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
15.915867ms
FAIL (2025-08-21 04:34:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:34:24.881978263 (299h8m5.613246003s) [upload=311028]: Starting upload Aug 21 04:34:24.882061829 (299h8m5.613329459s) [upload=311028]: Done starting upload Aug 21 04:34:24.882169603 (299h8m5.613437222s) [upload=311028]: Uploading segments... Aug 21 04:34:24.882374318 (299h8m5.613641948s) [upload=311028]: Got next segment. Inline: false Aug 21 04:34:24.882403101 (299h8m5.613670731s) [upload=311028]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:34:24.882407009 (299h8m5.613674639s) [upload=311028]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:34:24.884995262 (299h8m5.616262892s) [upload=311028]: Next segment err: metaclient: Too Many Requests Aug 21 04:34:24.885013566 (299h8m5.616281196s) [upload=311028]: Done uploading segments... Aug 21 04:34:24.885023846 (299h8m5.616291465s) [upload=311028]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.93315ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X.......X..............] duration:
146.755295ms
FAIL (2025-08-21 04:34:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.782906ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.......X.............] duration:
350.324418ms
FAIL (2025-08-21 04:33:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 350.341721ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.......X............] duration:
139.747265ms
FAIL (2025-08-21 04:33:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.822037ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.......X...........] duration:
149.728993ms
FAIL (2025-08-21 04:32:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.74828ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.......X..........] duration:
143.865205ms
FAIL (2025-08-21 04:31:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.884522ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.......X.........] duration:
154.992543ms
FAIL (2025-08-21 04:31:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.015937ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.......X........] duration:
185.737516ms
FAIL (2025-08-21 04:30:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 185.758656ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.......X.......] duration:
129.009214ms
FAIL (2025-08-21 04:29:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 129.036024ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.......X......] duration:
158.564424ms
FAIL (2025-08-21 04:29:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 158.586476ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.......X.....] duration:
447.191432ms
FAIL (2025-08-21 04:28:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 447.221547ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.......X....] duration:
387.844424ms
FAIL (2025-08-21 04:27:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 387.880612ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.......X...] duration:
137.665541ms
FAIL (2025-08-21 04:26:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 137.678434ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X................................................X.......X..] duration:
132.021741ms
FAIL (2025-08-21 04:26:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.043302ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X................................................X.......X.] duration:
138.837442ms
FAIL (2025-08-21 04:25:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 138.856678ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X................................................X.......X] duration:
16.082814ms
FAIL (2025-08-21 04:24:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:24:37.933841225 (298h58m18.665108845s) [upload=310854]: Starting upload Aug 21 04:24:37.933874387 (298h58m18.665142008s) [upload=310854]: Done starting upload Aug 21 04:24:37.933927597 (298h58m18.665195228s) [upload=310854]: Uploading segments... Aug 21 04:24:37.933955139 (298h58m18.665222759s) [upload=310854]: Got next segment. Inline: true Aug 21 04:24:37.933959146 (298h58m18.665226767s) [upload=310854]: Waiting for error group managing segments... Aug 21 04:24:37.934007477 (298h58m18.665275127s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:37.934014670 (298h58m18.6652823s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:37.934019410 (298h58m18.66528704s) [upload=310854]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:37.936724002 (298h58m18.667991623s) [upload=310854]: Done uploading segments... Aug 21 04:24:37.936735655 (298h58m18.668003275s) [upload=310854]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.099626ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X................................................X.......] duration:
505.354084ms
FAIL (2025-08-21 04:24:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:17:15.178117021 (298h50m55.909384661s) [upload=310734]: Starting upload Aug 21 04:17:15.178176002 (298h50m55.909443642s) [upload=310734]: Done starting upload Aug 21 04:17:15.178228762 (298h50m55.909496392s) [upload=310734]: Uploading segments... Aug 21 04:17:15.178258658 (298h50m55.909526288s) [upload=310734]: Got next segment. Inline: true Aug 21 04:17:15.178263327 (298h50m55.909530967s) [upload=310734]: Waiting for error group managing segments... Aug 21 04:17:15.178297260 (298h50m55.90956489s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:17:15.178301428 (298h50m55.909569058s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:17:15.178305295 (298h50m55.909572926s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:17:15.181314841 (298h50m55.912582491s) [upload=310734]: Done uploading segments... Aug 21 04:17:15.181327886 (298h50m55.912595525s) [upload=310734]: Upload finished. err: metaclient: Too Many Requests
Duration: 505.37308ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X................................................X......] duration:
143.752078ms
FAIL (2025-08-21 04:22:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:17:15.178117021 (298h50m55.909384661s) [upload=310734]: Starting upload Aug 21 04:17:15.178176002 (298h50m55.909443642s) [upload=310734]: Done starting upload Aug 21 04:17:15.178228762 (298h50m55.909496392s) [upload=310734]: Uploading segments... Aug 21 04:17:15.178258658 (298h50m55.909526288s) [upload=310734]: Got next segment. Inline: true Aug 21 04:17:15.178263327 (298h50m55.909530967s) [upload=310734]: Waiting for error group managing segments... Aug 21 04:17:15.178297260 (298h50m55.90956489s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:17:15.178301428 (298h50m55.909569058s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:17:15.178305295 (298h50m55.909572926s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:17:15.181314841 (298h50m55.912582491s) [upload=310734]: Done uploading segments... Aug 21 04:17:15.181327886 (298h50m55.912595525s) [upload=310734]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.770653ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X................................................X.....] duration:
142.985889ms
FAIL (2025-08-21 04:21:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:17:15.178117021 (298h50m55.909384661s) [upload=310734]: Starting upload Aug 21 04:17:15.178176002 (298h50m55.909443642s) [upload=310734]: Done starting upload Aug 21 04:17:15.178228762 (298h50m55.909496392s) [upload=310734]: Uploading segments... Aug 21 04:17:15.178258658 (298h50m55.909526288s) [upload=310734]: Got next segment. Inline: true Aug 21 04:17:15.178263327 (298h50m55.909530967s) [upload=310734]: Waiting for error group managing segments... Aug 21 04:17:15.178297260 (298h50m55.90956489s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:17:15.178301428 (298h50m55.909569058s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:17:15.178305295 (298h50m55.909572926s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:17:15.181314841 (298h50m55.912582491s) [upload=310734]: Done uploading segments... Aug 21 04:17:15.181327886 (298h50m55.912595525s) [upload=310734]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.008781ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X................................................X....] duration:
151.827994ms
FAIL (2025-08-21 04:20:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:17:15.178117021 (298h50m55.909384661s) [upload=310734]: Starting upload Aug 21 04:17:15.178176002 (298h50m55.909443642s) [upload=310734]: Done starting upload Aug 21 04:17:15.178228762 (298h50m55.909496392s) [upload=310734]: Uploading segments... Aug 21 04:17:15.178258658 (298h50m55.909526288s) [upload=310734]: Got next segment. Inline: true Aug 21 04:17:15.178263327 (298h50m55.909530967s) [upload=310734]: Waiting for error group managing segments... Aug 21 04:17:15.178297260 (298h50m55.90956489s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:17:15.178301428 (298h50m55.909569058s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:17:15.178305295 (298h50m55.909572926s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:17:15.181314841 (298h50m55.912582491s) [upload=310734]: Done uploading segments... Aug 21 04:17:15.181327886 (298h50m55.912595525s) [upload=310734]: Upload finished. err: metaclient: Too Many Requests
Duration: 151.847081ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X................................................X...] duration:
176.108144ms
FAIL (2025-08-21 04:20:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:17:15.178117021 (298h50m55.909384661s) [upload=310734]: Starting upload Aug 21 04:17:15.178176002 (298h50m55.909443642s) [upload=310734]: Done starting upload Aug 21 04:17:15.178228762 (298h50m55.909496392s) [upload=310734]: Uploading segments... Aug 21 04:17:15.178258658 (298h50m55.909526288s) [upload=310734]: Got next segment. Inline: true Aug 21 04:17:15.178263327 (298h50m55.909530967s) [upload=310734]: Waiting for error group managing segments... Aug 21 04:17:15.178297260 (298h50m55.90956489s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:17:15.178301428 (298h50m55.909569058s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:17:15.178305295 (298h50m55.909572926s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:17:15.181314841 (298h50m55.912582491s) [upload=310734]: Done uploading segments... Aug 21 04:17:15.181327886 (298h50m55.912595525s) [upload=310734]: Upload finished. err: metaclient: Too Many Requests
Duration: 176.126028ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X................................................X..] duration:
148.92118ms
FAIL (2025-08-21 04:19:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:17:15.178117021 (298h50m55.909384661s) [upload=310734]: Starting upload Aug 21 04:17:15.178176002 (298h50m55.909443642s) [upload=310734]: Done starting upload Aug 21 04:17:15.178228762 (298h50m55.909496392s) [upload=310734]: Uploading segments... Aug 21 04:17:15.178258658 (298h50m55.909526288s) [upload=310734]: Got next segment. Inline: true Aug 21 04:17:15.178263327 (298h50m55.909530967s) [upload=310734]: Waiting for error group managing segments... Aug 21 04:17:15.178297260 (298h50m55.90956489s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:17:15.178301428 (298h50m55.909569058s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:17:15.178305295 (298h50m55.909572926s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:17:15.181314841 (298h50m55.912582491s) [upload=310734]: Done uploading segments... Aug 21 04:17:15.181327886 (298h50m55.912595525s) [upload=310734]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.948472ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X................................................X.] duration:
126.242464ms
FAIL (2025-08-21 04:18:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:17:15.178117021 (298h50m55.909384661s) [upload=310734]: Starting upload Aug 21 04:17:15.178176002 (298h50m55.909443642s) [upload=310734]: Done starting upload Aug 21 04:17:15.178228762 (298h50m55.909496392s) [upload=310734]: Uploading segments... Aug 21 04:17:15.178258658 (298h50m55.909526288s) [upload=310734]: Got next segment. Inline: true Aug 21 04:17:15.178263327 (298h50m55.909530967s) [upload=310734]: Waiting for error group managing segments... Aug 21 04:17:15.178297260 (298h50m55.90956489s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:17:15.178301428 (298h50m55.909569058s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:17:15.178305295 (298h50m55.909572926s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:17:15.181314841 (298h50m55.912582491s) [upload=310734]: Done uploading segments... Aug 21 04:17:15.181327886 (298h50m55.912595525s) [upload=310734]: Upload finished. err: metaclient: Too Many Requests
Duration: 126.256731ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.........X................................................X] duration:
16.586421ms
FAIL (2025-08-21 04:17:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:17:15.178117021 (298h50m55.909384661s) [upload=310734]: Starting upload Aug 21 04:17:15.178176002 (298h50m55.909443642s) [upload=310734]: Done starting upload Aug 21 04:17:15.178228762 (298h50m55.909496392s) [upload=310734]: Uploading segments... Aug 21 04:17:15.178258658 (298h50m55.909526288s) [upload=310734]: Got next segment. Inline: true Aug 21 04:17:15.178263327 (298h50m55.909530967s) [upload=310734]: Waiting for error group managing segments... Aug 21 04:17:15.178297260 (298h50m55.90956489s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:17:15.178301428 (298h50m55.909569058s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:17:15.178305295 (298h50m55.909572926s) [upload=310734]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:17:15.181314841 (298h50m55.912582491s) [upload=310734]: Done uploading segments... Aug 21 04:17:15.181327886 (298h50m55.912595525s) [upload=310734]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.608341ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.........X................................................] duration:
222.872366ms
FAIL (2025-08-21 04:16:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 222.895309ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.........X...............................................] duration:
143.353138ms
FAIL (2025-08-21 04:15:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.371583ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.........X..............................................] duration:
131.080625ms
FAIL (2025-08-21 04:14:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 131.101395ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.........X.............................................] duration:
158.620871ms
FAIL (2025-08-21 04:13:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 158.638405ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.........X............................................] duration:
574.990316ms
FAIL (2025-08-21 04:12:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 575.015193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X.........X...........................................] duration:
272.987354ms
FAIL (2025-08-21 04:12:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 273.01128ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X.........X..........................................] duration:
555.761628ms
FAIL (2025-08-21 04:11:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 555.788919ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X.........X.........................................] duration:
189.061992ms
FAIL (2025-08-21 04:10:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 189.086257ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X.........X........................................] duration:
439.15155ms
FAIL (2025-08-21 04:09:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 439.185024ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X.........X.......................................] duration:
562.636391ms
FAIL (2025-08-21 04:08:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 562.655427ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X.........X......................................] duration:
253.552427ms
FAIL (2025-08-21 04:07:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 253.573285ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.0568133s
FAIL (2025-08-21 04:06:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.056879584s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X.........X.....................................] duration:
156.00775ms
FAIL (2025-08-21 04:06:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 156.029882ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X.........X....................................] duration:
257.377267ms
FAIL (2025-08-21 04:06:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 257.392596ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.591951329s
FAIL (2025-08-21 04:06:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.591971868s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X.........X...................................] duration:
423.053774ms
FAIL (2025-08-21 04:06:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 423.093619ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.615545416s
FAIL (2025-08-21 04:05:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.615574691s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.831682353s
FAIL (2025-08-21 04:04:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.831708551s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X.........X..................................] duration:
130.764047ms
FAIL (2025-08-21 04:04:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 130.790245ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X.........X.................................] duration:
160.65573ms
FAIL (2025-08-21 04:04:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 03:39:59.637891422 (298h13m40.369159042s) [upload=310088]: Starting upload Aug 21 03:39:59.637932459 (298h13m40.369200089s) [upload=310088]: Done starting upload Aug 21 03:39:59.637979538 (298h13m40.369247158s) [upload=310088]: Uploading segments... Aug 21 03:39:59.638007871 (298h13m40.369275491s) [upload=310088]: Got next segment. Inline: true Aug 21 03:39:59.638011247 (298h13m40.369278877s) [upload=310088]: Waiting for error group managing segments... Aug 21 03:39:59.638040703 (298h13m40.369308333s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 03:39:59.638044249 (298h13m40.369311869s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 03:39:59.638046724 (298h13m40.369314354s) [upload=310088]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 03:39:59.640129849 (298h13m40.371397479s) [upload=310088]: Done uploading segments... Aug 21 03:39:59.640137845 (298h13m40.371405465s) [upload=310088]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.67223ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.378094848s
FAIL (2025-08-21 04:03:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 03:22:21.416206589 (297h56m2.147474219s) [upload=309778]: Starting upload
Aug 21 03:22:21.416264066 (297h56m2.147531696s) [upload=309778]: Done starting upload
Aug 21 03:22:21.416348496 (297h56m2.147616116s) [upload=309778]: Uploading segments...
Aug 21 03:22:21.416519918 (297h56m2.147787577s) [upload=309778]: Got next segment. Inline: false
Aug 21 03:22:21.416561436 (297h56m2.147829066s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 03:22:21.416567908 (297h56m2.147835529s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 03:22:21.440095038 (297h56m2.171362668s) [seg_pos={0 0}, upload=309778]: Begin upload segment...
Aug 21 03:22:21.440124162 (297h56m2.171391782s) [seg_pos={0 0}, upload=309778]: Done begin upload segment.
Aug 21 03:22:21.440141926 (297h56m2.171409545s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440149300 (297h56m2.17141693s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440229009 (297h56m2.171496629s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440417894 (297h56m2.171685515s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440509556 (297h56m2.171777186s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440681359 (297h56m2.171948989s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440723629 (297h56m2.171991259s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440944043 (297h56m2.172211663s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.440996402 (297h56m2.172264032s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441176971 (297h56m2.172444591s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441400150 (297h56m2.172667771s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441605096 (297h56m2.172872726s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.441840719 (297h56m2.173108338s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442066223 (297h56m2.173333842s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442272200 (297h56m2.17353983s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442491933 (297h56m2.173759553s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.442816073 (297h56m2.174083693s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.443118992 (297h56m2.174386612s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Uploading piece...
Aug 21 03:22:21.529748369 (297h56m2.261015999s) [upload=309778]: Next returned nil segment
Aug 21 03:22:21.529760863 (297h56m2.261028483s) [upload=309778]: Waiting for error group managing segments...
Aug 21 03:22:21.538160283 (297h56m2.269427904s) [noise=true , address=45.91.116.13:4181 , piece_id=7FGDYFSQFHN6FKWOKEETS7E56MC6PZIK2LLUNWP6DYG5DTQ4OHZQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.539895686 (297h56m2.271163306s) [noise=true , address=79.127.219.47:4067 , piece_id=STQCHSDUMZFZQ5ARASHFNV5A2V64OMJ4E4HPKX3ZS7HZGFE6BBFA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541035749 (297h56m2.272303369s) [noise=true , address=77.90.31.10:4529 , piece_id=Z2PHT5ACD3ZCQQZ2HKIVQSANIGP2OQITALEVE5JVGI36TVYLZJEA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.541299575 (297h56m2.272567195s) [noise=true , address=45.91.116.12:4228 , piece_id=NNFG2HLY6BKJKEYTDN6GSXDBKFOAFXMQCBF5C227PYGWVJQGRVOQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.546060054 (297h56m2.277327675s) [noise=true , address=77.90.31.16:4757 , piece_id=A3AC3U2KQ7OUX7RYVQ4NYJQ2NRF5YJMR5SOKL3K65ZGTNX6M6G2A, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.552005552 (297h56m2.283273172s) [noise=true , address=77.90.31.13:4644 , piece_id=DWS5SGFMB47LTODZ6DSVD7KMYAANEFAVJCN5EXI6X2OAQMJTVMSA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.558533032 (297h56m2.289800653s) [noise=true , address=77.90.31.21:4893 , piece_id=Y5OGEBAYXTEYEMQUT4HNMTWQF4CAVUNUS3OUEYJWYD7A7HW5YSGA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.559195588 (297h56m2.290463208s) [noise=true , address=45.91.116.14:4193 , piece_id=ULMYZFFW5OFZCRJYDBFF3MQ576G3GQ5ABPAOCJRVGSRGGLKLGFYA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.561633051 (297h56m2.292900671s) [noise=true , address=77.90.31.15:4722 , piece_id=7KUSTORXPH3F5POG36MWGAQR2HAR2SJQMAXHY7AHLOAI5EZVG2SQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.575061806 (297h56m2.306329437s) [noise=true , address=77.90.31.17:4788 , piece_id=5DLYGW7PMQ6LXJKQ445DRO3EJL3P4REBJIBZLZUKAPIZUQVSQOEQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.577622880 (297h56m2.308890501s) [noise=true , address=77.90.31.18:4808 , piece_id=ZQ3HOKA6MIWKSTPS2MQJDGU6SA7C4E6BBOK7KF5MA6FEYVJWWLQA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.580981856 (297h56m2.312249475s) [noise=true , address=77.90.31.14:4690 , piece_id=JCI5P3UGF2ZEARWENZ4MJCBN4KJW6CGM6PBK27FEDY23TTJ2LRWA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.596921101 (297h56m2.328188731s) [noise=true , address=104.36.82.43:4845 , piece_id=EPVYNBDYT4RRDUG5YZNJNPKGORFGI6J5DOCCFOMGUHNSM54KMAIQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611876765 (297h56m2.343144395s) [noise=true , address=104.36.82.45:4931 , piece_id=WNMAM5UKO43HUPXFH6IYU26VO3HXHGBFBYC46LTLREA6Z52WPGHQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: <nil>
Aug 21 03:22:21.611940024 (297h56m2.343207645s) [seg_pos={0 0}, upload=309778]: Segment reached optimal threshold of 14 pieces.
Aug 21 03:22:21.612107900 (297h56m2.34337553s) [noise=true , address=79.127.220.97:4395 , piece_id=4PZWFZK7KH2GEZSN2ERHP3CC5VHKEKLGRCHS5SAFODFZCCAUE37Q, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CbHZ4wV7SB5CEJGmcQNmV77odxiLfsbkkmS3SWHZ4CohAwme5): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612170849 (297h56m2.343438479s) [noise=true , address=104.36.82.23:4478 , piece_id=6UV4ALL5R2UMZNZWW5ZQY6OLA7OS2ZTSGLCRY5NSCMCDD5ZMD5FA, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EvdsFq3xEc1mmD5y1PMsNo685MbFj1zCMby8WBvxBee4emtpR): protocol: expected piece hash; context canceled; EOF
Aug 21 03:22:21.612367047 (297h56m2.343634677s) [noise=true , address=79.127.205.233:4643 , piece_id=YGTA7DV7BTHL5R4Z376BJUH5RUUCE24DUDQQEQEUD2F3XDKTSZVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cVbdibJiX3T4fEUjeVBNNTTNaMb7m3QYDmxh17Dic5wVUQ9fx): protocol: read tcp 5.161.89.252:9980->79.127.205.233:4643: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612400009 (297h56m2.343667639s) [noise=true , address=79.127.205.246:4284 , piece_id=VEAFJQUGGYEDWNHPS6MNF7VDCBDSUQ6ZJ5AFBB66ZYSD6TXVCMVQ, seg_pos={0 0}, upload=309778]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: read tcp 5.161.89.252:42052->79.127.205.246:4284: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 21 03:22:21.612408324 (297h56m2.343675954s) [seg_pos={0 0}, upload=309778]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 03:22:21.612456236 (297h56m2.343723856s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 03:22:21.612459371 (297h56m2.343726991s) [upload=309778]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 03:22:21.700899823 (297h56m2.432167463s) [upload=309778]: Done uploading segments...
Aug 21 03:22:21.700919790 (297h56m2.43218741s) [upload=309778]: Upload finished. err: <nil>
Duration: 1.378119103s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|