Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X...................................X...............] duration:
382.872574ms
FAIL (2025-08-16 14:30:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 382.890627ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X........X.........] duration:
3.201544013s
FAIL (2025-08-16 14:29:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.20156328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
15.410885493s
FAIL (2025-08-16 14:29:33 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 15.410903798s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X...................................X..............] duration:
264.38204ms
FAIL (2025-08-16 14:29:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 264.405214ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.00472124s
FAIL (2025-08-16 14:28:59 UTC)
orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded
Duration: 30.004743412s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X...................................X.............] duration:
1.078825309s
FAIL (2025-08-16 14:28:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.078846409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X........X........] duration:
2.587143768s
FAIL (2025-08-16 14:28:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.587182641s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X........X.......] duration:
1.675962812s
FAIL (2025-08-16 14:28:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.675985715s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X...................................X............] duration:
988.809689ms
FAIL (2025-08-16 14:27:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 988.838112ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X........X......] duration:
2.101540528s
FAIL (2025-08-16 14:27:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.101561417s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X........X.....] duration:
1.452400742s
FAIL (2025-08-16 14:26:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.452422492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X...................................X...........] duration:
714.366527ms
FAIL (2025-08-16 14:26:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 714.379341ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X........X....] duration:
1.226423432s
FAIL (2025-08-16 14:25:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.22644902s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X...................................X..........] duration:
488.29493ms
FAIL (2025-08-16 14:25:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 488.320739ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X...................................X.........] duration:
833.404651ms
FAIL (2025-08-16 14:24:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 833.422313ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X........X...] duration:
1.883334194s
FAIL (2025-08-16 14:24:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.883357458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X........X..] duration:
1.768505869s
FAIL (2025-08-16 14:24:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.768539511s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X...................................X........] duration:
372.03433ms
FAIL (2025-08-16 14:23:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 372.058106ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X........X.] duration:
1.641663287s
FAIL (2025-08-16 14:23:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.641694955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X...................................X.......] duration:
774.842828ms
FAIL (2025-08-16 14:23:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 774.868456ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X........X] duration:
15.385924ms
FAIL (2025-08-16 14:23:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:23:10.478810879 (188h56m51.210078499s) [upload=196616]: Starting upload Aug 16 14:23:10.478872666 (188h56m51.210140316s) [upload=196616]: Done starting upload Aug 16 14:23:10.478932628 (188h56m51.210200259s) [upload=196616]: Uploading segments... Aug 16 14:23:10.479197186 (188h56m51.210464816s) [upload=196616]: Got next segment. Inline: false Aug 16 14:23:10.479224900 (188h56m51.21049252s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:23:10.479228587 (188h56m51.210496217s) [upload=196616]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 14:23:10.481835968 (188h56m51.213103598s) [upload=196616]: Next segment err: metaclient: Too Many Requests Aug 16 14:23:10.481847289 (188h56m51.213114909s) [upload=196616]: Done uploading segments... Aug 16 14:23:10.481872918 (188h56m51.213140538s) [upload=196616]: Upload finished. err: metaclient: Too Many Requests
Duration: 15.401625ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X...................................X......] duration:
459.661534ms
FAIL (2025-08-16 14:23:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 459.687252ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X...................................X.....] duration:
506.158349ms
FAIL (2025-08-16 14:22:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 506.181473ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.115364336s
FAIL (2025-08-16 14:22:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 14:16:17.941364946 (188h49m58.672632576s) [upload=196499]: Starting upload
Aug 16 14:16:17.941397227 (188h49m58.672664847s) [upload=196499]: Done starting upload
Aug 16 14:16:17.941500261 (188h49m58.672767891s) [upload=196499]: Uploading segments...
Aug 16 14:16:17.941625838 (188h49m58.672893459s) [upload=196499]: Got next segment. Inline: false
Aug 16 14:16:17.941656596 (188h49m58.672924216s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:16:17.941660253 (188h49m58.672927872s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:16:18.017152720 (188h49m58.748420351s) [seg_pos={0 0}, upload=196499]: Begin upload segment...
Aug 16 14:16:18.017192346 (188h49m58.748459976s) [seg_pos={0 0}, upload=196499]: Done begin upload segment.
Aug 16 14:16:18.017219977 (188h49m58.748487608s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017238192 (188h49m58.748505822s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017530493 (188h49m58.748798123s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017683371 (188h49m58.748951001s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017822873 (188h49m58.749090503s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017954792 (188h49m58.749222412s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018071551 (188h49m58.749339181s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018297016 (188h49m58.749564646s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018334989 (188h49m58.749602609s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018565412 (188h49m58.749833042s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018588907 (188h49m58.749856527s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018774746 (188h49m58.750042367s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018844959 (188h49m58.750112589s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019032252 (188h49m58.750299882s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019167447 (188h49m58.750435087s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019301099 (188h49m58.750568738s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019571457 (188h49m58.750839138s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019602145 (188h49m58.750869785s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.115744005 (188h49m58.847011635s) [upload=196499]: Next returned nil segment
Aug 16 14:16:18.115754284 (188h49m58.847021904s) [upload=196499]: Waiting for error group managing segments...
Aug 16 14:16:18.130232519 (188h49m58.861500149s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.157122637 (188h49m58.888390268s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.162570830 (188h49m58.89383847s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.167405859 (188h49m58.898673499s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.194464054 (188h49m58.925731714s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.212933918 (188h49m58.944201568s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.251849571 (188h49m58.983117221s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.275167749 (188h49m59.00643541s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.295695371 (188h49m59.026963021s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.316649887 (188h49m59.047917537s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.328541508 (188h49m59.059809159s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.332228053 (188h49m59.063495704s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.670407611 (188h49m59.401675261s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944879583 (188h49m59.676147213s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944906283 (188h49m59.676173913s) [seg_pos={0 0}, upload=196499]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:16:18.945013435 (188h49m59.676281055s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945052779 (188h49m59.676320399s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945091341 (188h49m59.676358971s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945174177 (188h49m59.676441797s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection; write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection
Aug 16 14:16:18.945199235 (188h49m59.676466865s) [seg_pos={0 0}, upload=196499]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:16:18.945263225 (188h49m59.676530845s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:16:18.945267283 (188h49m59.676534903s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:16:20.002691068 (188h50m0.733958748s) [upload=196499]: Done uploading segments...
Aug 16 14:16:20.002716066 (188h50m0.733983715s) [upload=196499]: Upload finished. err: <nil>
Duration: 1.115388954s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X...................................X....] duration:
509.347055ms
FAIL (2025-08-16 14:22:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 509.366202ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X...................................X...] duration:
342.48986ms
FAIL (2025-08-16 14:21:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 342.509446ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.306007433s
FAIL (2025-08-16 14:21:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 14:16:17.941364946 (188h49m58.672632576s) [upload=196499]: Starting upload
Aug 16 14:16:17.941397227 (188h49m58.672664847s) [upload=196499]: Done starting upload
Aug 16 14:16:17.941500261 (188h49m58.672767891s) [upload=196499]: Uploading segments...
Aug 16 14:16:17.941625838 (188h49m58.672893459s) [upload=196499]: Got next segment. Inline: false
Aug 16 14:16:17.941656596 (188h49m58.672924216s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:16:17.941660253 (188h49m58.672927872s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:16:18.017152720 (188h49m58.748420351s) [seg_pos={0 0}, upload=196499]: Begin upload segment...
Aug 16 14:16:18.017192346 (188h49m58.748459976s) [seg_pos={0 0}, upload=196499]: Done begin upload segment.
Aug 16 14:16:18.017219977 (188h49m58.748487608s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017238192 (188h49m58.748505822s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017530493 (188h49m58.748798123s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017683371 (188h49m58.748951001s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017822873 (188h49m58.749090503s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017954792 (188h49m58.749222412s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018071551 (188h49m58.749339181s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018297016 (188h49m58.749564646s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018334989 (188h49m58.749602609s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018565412 (188h49m58.749833042s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018588907 (188h49m58.749856527s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018774746 (188h49m58.750042367s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018844959 (188h49m58.750112589s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019032252 (188h49m58.750299882s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019167447 (188h49m58.750435087s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019301099 (188h49m58.750568738s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019571457 (188h49m58.750839138s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019602145 (188h49m58.750869785s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.115744005 (188h49m58.847011635s) [upload=196499]: Next returned nil segment
Aug 16 14:16:18.115754284 (188h49m58.847021904s) [upload=196499]: Waiting for error group managing segments...
Aug 16 14:16:18.130232519 (188h49m58.861500149s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.157122637 (188h49m58.888390268s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.162570830 (188h49m58.89383847s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.167405859 (188h49m58.898673499s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.194464054 (188h49m58.925731714s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.212933918 (188h49m58.944201568s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.251849571 (188h49m58.983117221s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.275167749 (188h49m59.00643541s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.295695371 (188h49m59.026963021s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.316649887 (188h49m59.047917537s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.328541508 (188h49m59.059809159s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.332228053 (188h49m59.063495704s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.670407611 (188h49m59.401675261s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944879583 (188h49m59.676147213s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944906283 (188h49m59.676173913s) [seg_pos={0 0}, upload=196499]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:16:18.945013435 (188h49m59.676281055s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945052779 (188h49m59.676320399s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945091341 (188h49m59.676358971s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945174177 (188h49m59.676441797s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection; write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection
Aug 16 14:16:18.945199235 (188h49m59.676466865s) [seg_pos={0 0}, upload=196499]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:16:18.945263225 (188h49m59.676530845s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:16:18.945267283 (188h49m59.676534903s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:16:20.002691068 (188h50m0.733958748s) [upload=196499]: Done uploading segments...
Aug 16 14:16:20.002716066 (188h50m0.733983715s) [upload=196499]: Upload finished. err: <nil>
Duration: 1.306052108s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...................................X..] duration:
279.190279ms
FAIL (2025-08-16 14:21:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 279.208804ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.158620545s
FAIL (2025-08-16 14:20:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 14:16:17.941364946 (188h49m58.672632576s) [upload=196499]: Starting upload
Aug 16 14:16:17.941397227 (188h49m58.672664847s) [upload=196499]: Done starting upload
Aug 16 14:16:17.941500261 (188h49m58.672767891s) [upload=196499]: Uploading segments...
Aug 16 14:16:17.941625838 (188h49m58.672893459s) [upload=196499]: Got next segment. Inline: false
Aug 16 14:16:17.941656596 (188h49m58.672924216s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:16:17.941660253 (188h49m58.672927872s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:16:18.017152720 (188h49m58.748420351s) [seg_pos={0 0}, upload=196499]: Begin upload segment...
Aug 16 14:16:18.017192346 (188h49m58.748459976s) [seg_pos={0 0}, upload=196499]: Done begin upload segment.
Aug 16 14:16:18.017219977 (188h49m58.748487608s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017238192 (188h49m58.748505822s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017530493 (188h49m58.748798123s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017683371 (188h49m58.748951001s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017822873 (188h49m58.749090503s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017954792 (188h49m58.749222412s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018071551 (188h49m58.749339181s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018297016 (188h49m58.749564646s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018334989 (188h49m58.749602609s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018565412 (188h49m58.749833042s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018588907 (188h49m58.749856527s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018774746 (188h49m58.750042367s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018844959 (188h49m58.750112589s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019032252 (188h49m58.750299882s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019167447 (188h49m58.750435087s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019301099 (188h49m58.750568738s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019571457 (188h49m58.750839138s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019602145 (188h49m58.750869785s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.115744005 (188h49m58.847011635s) [upload=196499]: Next returned nil segment
Aug 16 14:16:18.115754284 (188h49m58.847021904s) [upload=196499]: Waiting for error group managing segments...
Aug 16 14:16:18.130232519 (188h49m58.861500149s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.157122637 (188h49m58.888390268s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.162570830 (188h49m58.89383847s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.167405859 (188h49m58.898673499s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.194464054 (188h49m58.925731714s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.212933918 (188h49m58.944201568s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.251849571 (188h49m58.983117221s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.275167749 (188h49m59.00643541s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.295695371 (188h49m59.026963021s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.316649887 (188h49m59.047917537s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.328541508 (188h49m59.059809159s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.332228053 (188h49m59.063495704s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.670407611 (188h49m59.401675261s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944879583 (188h49m59.676147213s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944906283 (188h49m59.676173913s) [seg_pos={0 0}, upload=196499]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:16:18.945013435 (188h49m59.676281055s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945052779 (188h49m59.676320399s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945091341 (188h49m59.676358971s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945174177 (188h49m59.676441797s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection; write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection
Aug 16 14:16:18.945199235 (188h49m59.676466865s) [seg_pos={0 0}, upload=196499]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:16:18.945263225 (188h49m59.676530845s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:16:18.945267283 (188h49m59.676534903s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:16:20.002691068 (188h50m0.733958748s) [upload=196499]: Done uploading segments...
Aug 16 14:16:20.002716066 (188h50m0.733983715s) [upload=196499]: Upload finished. err: <nil>
Duration: 1.158641976s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X...................................X.] duration:
385.361844ms
FAIL (2025-08-16 14:20:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 385.394576ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.252259881s
FAIL (2025-08-16 14:20:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 14:16:17.941364946 (188h49m58.672632576s) [upload=196499]: Starting upload
Aug 16 14:16:17.941397227 (188h49m58.672664847s) [upload=196499]: Done starting upload
Aug 16 14:16:17.941500261 (188h49m58.672767891s) [upload=196499]: Uploading segments...
Aug 16 14:16:17.941625838 (188h49m58.672893459s) [upload=196499]: Got next segment. Inline: false
Aug 16 14:16:17.941656596 (188h49m58.672924216s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:16:17.941660253 (188h49m58.672927872s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:16:18.017152720 (188h49m58.748420351s) [seg_pos={0 0}, upload=196499]: Begin upload segment...
Aug 16 14:16:18.017192346 (188h49m58.748459976s) [seg_pos={0 0}, upload=196499]: Done begin upload segment.
Aug 16 14:16:18.017219977 (188h49m58.748487608s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017238192 (188h49m58.748505822s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017530493 (188h49m58.748798123s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017683371 (188h49m58.748951001s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017822873 (188h49m58.749090503s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017954792 (188h49m58.749222412s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018071551 (188h49m58.749339181s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018297016 (188h49m58.749564646s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018334989 (188h49m58.749602609s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018565412 (188h49m58.749833042s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018588907 (188h49m58.749856527s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018774746 (188h49m58.750042367s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018844959 (188h49m58.750112589s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019032252 (188h49m58.750299882s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019167447 (188h49m58.750435087s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019301099 (188h49m58.750568738s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019571457 (188h49m58.750839138s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019602145 (188h49m58.750869785s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.115744005 (188h49m58.847011635s) [upload=196499]: Next returned nil segment
Aug 16 14:16:18.115754284 (188h49m58.847021904s) [upload=196499]: Waiting for error group managing segments...
Aug 16 14:16:18.130232519 (188h49m58.861500149s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.157122637 (188h49m58.888390268s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.162570830 (188h49m58.89383847s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.167405859 (188h49m58.898673499s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.194464054 (188h49m58.925731714s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.212933918 (188h49m58.944201568s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.251849571 (188h49m58.983117221s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.275167749 (188h49m59.00643541s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.295695371 (188h49m59.026963021s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.316649887 (188h49m59.047917537s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.328541508 (188h49m59.059809159s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.332228053 (188h49m59.063495704s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.670407611 (188h49m59.401675261s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944879583 (188h49m59.676147213s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944906283 (188h49m59.676173913s) [seg_pos={0 0}, upload=196499]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:16:18.945013435 (188h49m59.676281055s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945052779 (188h49m59.676320399s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945091341 (188h49m59.676358971s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945174177 (188h49m59.676441797s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection; write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection
Aug 16 14:16:18.945199235 (188h49m59.676466865s) [seg_pos={0 0}, upload=196499]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:16:18.945263225 (188h49m59.676530845s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:16:18.945267283 (188h49m59.676534903s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:16:20.002691068 (188h50m0.733958748s) [upload=196499]: Done uploading segments...
Aug 16 14:16:20.002716066 (188h50m0.733983715s) [upload=196499]: Upload finished. err: <nil>
Duration: 1.252281571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...................................X] duration:
33.500599ms
FAIL (2025-08-16 14:19:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 14:19:55.392348603 (188h53m36.123616253s) [upload=196558]: Starting upload Aug 16 14:19:55.392413835 (188h53m36.123681465s) [upload=196558]: Done starting upload Aug 16 14:19:55.392478257 (188h53m36.123745877s) [upload=196558]: Uploading segments... Aug 16 14:19:55.392524073 (188h53m36.123791712s) [upload=196558]: Got next segment. Inline: true Aug 16 14:19:55.392532609 (188h53m36.123800229s) [upload=196558]: Waiting for error group managing segments... Aug 16 14:19:55.392576782 (188h53m36.123844412s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 14:19:55.392583505 (188h53m36.123851135s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 14:19:55.392588043 (188h53m36.123855673s) [upload=196558]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 14:19:55.415388546 (188h53m36.146656196s) [upload=196558]: Done uploading segments... Aug 16 14:19:55.415406199 (188h53m36.146673849s) [upload=196558]: Upload finished. err: metaclient: Too Many Requests
Duration: 33.519534ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
210.585937ms
FAIL (2025-08-16 14:19:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 210.604843ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.041344405s
FAIL (2025-08-16 14:19:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 14:16:17.941364946 (188h49m58.672632576s) [upload=196499]: Starting upload
Aug 16 14:16:17.941397227 (188h49m58.672664847s) [upload=196499]: Done starting upload
Aug 16 14:16:17.941500261 (188h49m58.672767891s) [upload=196499]: Uploading segments...
Aug 16 14:16:17.941625838 (188h49m58.672893459s) [upload=196499]: Got next segment. Inline: false
Aug 16 14:16:17.941656596 (188h49m58.672924216s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:16:17.941660253 (188h49m58.672927872s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:16:18.017152720 (188h49m58.748420351s) [seg_pos={0 0}, upload=196499]: Begin upload segment...
Aug 16 14:16:18.017192346 (188h49m58.748459976s) [seg_pos={0 0}, upload=196499]: Done begin upload segment.
Aug 16 14:16:18.017219977 (188h49m58.748487608s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017238192 (188h49m58.748505822s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017530493 (188h49m58.748798123s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017683371 (188h49m58.748951001s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017822873 (188h49m58.749090503s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017954792 (188h49m58.749222412s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018071551 (188h49m58.749339181s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018297016 (188h49m58.749564646s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018334989 (188h49m58.749602609s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018565412 (188h49m58.749833042s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018588907 (188h49m58.749856527s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018774746 (188h49m58.750042367s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018844959 (188h49m58.750112589s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019032252 (188h49m58.750299882s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019167447 (188h49m58.750435087s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019301099 (188h49m58.750568738s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019571457 (188h49m58.750839138s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019602145 (188h49m58.750869785s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.115744005 (188h49m58.847011635s) [upload=196499]: Next returned nil segment
Aug 16 14:16:18.115754284 (188h49m58.847021904s) [upload=196499]: Waiting for error group managing segments...
Aug 16 14:16:18.130232519 (188h49m58.861500149s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.157122637 (188h49m58.888390268s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.162570830 (188h49m58.89383847s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.167405859 (188h49m58.898673499s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.194464054 (188h49m58.925731714s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.212933918 (188h49m58.944201568s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.251849571 (188h49m58.983117221s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.275167749 (188h49m59.00643541s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.295695371 (188h49m59.026963021s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.316649887 (188h49m59.047917537s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.328541508 (188h49m59.059809159s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.332228053 (188h49m59.063495704s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.670407611 (188h49m59.401675261s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944879583 (188h49m59.676147213s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944906283 (188h49m59.676173913s) [seg_pos={0 0}, upload=196499]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:16:18.945013435 (188h49m59.676281055s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945052779 (188h49m59.676320399s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945091341 (188h49m59.676358971s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945174177 (188h49m59.676441797s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection; write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection
Aug 16 14:16:18.945199235 (188h49m59.676466865s) [seg_pos={0 0}, upload=196499]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:16:18.945263225 (188h49m59.676530845s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:16:18.945267283 (188h49m59.676534903s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:16:20.002691068 (188h50m0.733958748s) [upload=196499]: Done uploading segments...
Aug 16 14:16:20.002716066 (188h50m0.733983715s) [upload=196499]: Upload finished. err: <nil>
Duration: 1.041367778s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
498.325224ms
FAIL (2025-08-16 14:18:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 498.357955ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.468846584s
FAIL (2025-08-16 14:18:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 14:16:17.941364946 (188h49m58.672632576s) [upload=196499]: Starting upload
Aug 16 14:16:17.941397227 (188h49m58.672664847s) [upload=196499]: Done starting upload
Aug 16 14:16:17.941500261 (188h49m58.672767891s) [upload=196499]: Uploading segments...
Aug 16 14:16:17.941625838 (188h49m58.672893459s) [upload=196499]: Got next segment. Inline: false
Aug 16 14:16:17.941656596 (188h49m58.672924216s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:16:17.941660253 (188h49m58.672927872s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:16:18.017152720 (188h49m58.748420351s) [seg_pos={0 0}, upload=196499]: Begin upload segment...
Aug 16 14:16:18.017192346 (188h49m58.748459976s) [seg_pos={0 0}, upload=196499]: Done begin upload segment.
Aug 16 14:16:18.017219977 (188h49m58.748487608s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017238192 (188h49m58.748505822s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017530493 (188h49m58.748798123s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017683371 (188h49m58.748951001s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017822873 (188h49m58.749090503s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017954792 (188h49m58.749222412s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018071551 (188h49m58.749339181s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018297016 (188h49m58.749564646s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018334989 (188h49m58.749602609s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018565412 (188h49m58.749833042s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018588907 (188h49m58.749856527s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018774746 (188h49m58.750042367s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018844959 (188h49m58.750112589s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019032252 (188h49m58.750299882s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019167447 (188h49m58.750435087s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019301099 (188h49m58.750568738s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019571457 (188h49m58.750839138s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019602145 (188h49m58.750869785s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.115744005 (188h49m58.847011635s) [upload=196499]: Next returned nil segment
Aug 16 14:16:18.115754284 (188h49m58.847021904s) [upload=196499]: Waiting for error group managing segments...
Aug 16 14:16:18.130232519 (188h49m58.861500149s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.157122637 (188h49m58.888390268s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.162570830 (188h49m58.89383847s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.167405859 (188h49m58.898673499s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.194464054 (188h49m58.925731714s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.212933918 (188h49m58.944201568s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.251849571 (188h49m58.983117221s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.275167749 (188h49m59.00643541s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.295695371 (188h49m59.026963021s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.316649887 (188h49m59.047917537s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.328541508 (188h49m59.059809159s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.332228053 (188h49m59.063495704s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.670407611 (188h49m59.401675261s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944879583 (188h49m59.676147213s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944906283 (188h49m59.676173913s) [seg_pos={0 0}, upload=196499]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:16:18.945013435 (188h49m59.676281055s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945052779 (188h49m59.676320399s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945091341 (188h49m59.676358971s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945174177 (188h49m59.676441797s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection; write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection
Aug 16 14:16:18.945199235 (188h49m59.676466865s) [seg_pos={0 0}, upload=196499]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:16:18.945263225 (188h49m59.676530845s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:16:18.945267283 (188h49m59.676534903s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:16:20.002691068 (188h50m0.733958748s) [upload=196499]: Done uploading segments...
Aug 16 14:16:20.002716066 (188h50m0.733983715s) [upload=196499]: Upload finished. err: <nil>
Duration: 1.468867994s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
185.054378ms
FAIL (2025-08-16 14:17:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 185.126984ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
891.626942ms
FAIL (2025-08-16 14:17:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 14:16:17.941364946 (188h49m58.672632576s) [upload=196499]: Starting upload
Aug 16 14:16:17.941397227 (188h49m58.672664847s) [upload=196499]: Done starting upload
Aug 16 14:16:17.941500261 (188h49m58.672767891s) [upload=196499]: Uploading segments...
Aug 16 14:16:17.941625838 (188h49m58.672893459s) [upload=196499]: Got next segment. Inline: false
Aug 16 14:16:17.941656596 (188h49m58.672924216s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:16:17.941660253 (188h49m58.672927872s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:16:18.017152720 (188h49m58.748420351s) [seg_pos={0 0}, upload=196499]: Begin upload segment...
Aug 16 14:16:18.017192346 (188h49m58.748459976s) [seg_pos={0 0}, upload=196499]: Done begin upload segment.
Aug 16 14:16:18.017219977 (188h49m58.748487608s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017238192 (188h49m58.748505822s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017530493 (188h49m58.748798123s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017683371 (188h49m58.748951001s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017822873 (188h49m58.749090503s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017954792 (188h49m58.749222412s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018071551 (188h49m58.749339181s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018297016 (188h49m58.749564646s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018334989 (188h49m58.749602609s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018565412 (188h49m58.749833042s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018588907 (188h49m58.749856527s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018774746 (188h49m58.750042367s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018844959 (188h49m58.750112589s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019032252 (188h49m58.750299882s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019167447 (188h49m58.750435087s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019301099 (188h49m58.750568738s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019571457 (188h49m58.750839138s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019602145 (188h49m58.750869785s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.115744005 (188h49m58.847011635s) [upload=196499]: Next returned nil segment
Aug 16 14:16:18.115754284 (188h49m58.847021904s) [upload=196499]: Waiting for error group managing segments...
Aug 16 14:16:18.130232519 (188h49m58.861500149s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.157122637 (188h49m58.888390268s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.162570830 (188h49m58.89383847s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.167405859 (188h49m58.898673499s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.194464054 (188h49m58.925731714s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.212933918 (188h49m58.944201568s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.251849571 (188h49m58.983117221s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.275167749 (188h49m59.00643541s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.295695371 (188h49m59.026963021s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.316649887 (188h49m59.047917537s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.328541508 (188h49m59.059809159s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.332228053 (188h49m59.063495704s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.670407611 (188h49m59.401675261s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944879583 (188h49m59.676147213s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944906283 (188h49m59.676173913s) [seg_pos={0 0}, upload=196499]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:16:18.945013435 (188h49m59.676281055s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945052779 (188h49m59.676320399s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945091341 (188h49m59.676358971s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945174177 (188h49m59.676441797s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection; write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection
Aug 16 14:16:18.945199235 (188h49m59.676466865s) [seg_pos={0 0}, upload=196499]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:16:18.945263225 (188h49m59.676530845s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:16:18.945267283 (188h49m59.676534903s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:16:20.002691068 (188h50m0.733958748s) [upload=196499]: Done uploading segments...
Aug 16 14:16:20.002716066 (188h50m0.733983715s) [upload=196499]: Upload finished. err: <nil>
Duration: 891.663562ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
668.41011ms
FAIL (2025-08-16 14:16:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 668.435718ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.976478649s
FAIL (2025-08-16 14:16:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 14:16:17.941364946 (188h49m58.672632576s) [upload=196499]: Starting upload
Aug 16 14:16:17.941397227 (188h49m58.672664847s) [upload=196499]: Done starting upload
Aug 16 14:16:17.941500261 (188h49m58.672767891s) [upload=196499]: Uploading segments...
Aug 16 14:16:17.941625838 (188h49m58.672893459s) [upload=196499]: Got next segment. Inline: false
Aug 16 14:16:17.941656596 (188h49m58.672924216s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:16:17.941660253 (188h49m58.672927872s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:16:18.017152720 (188h49m58.748420351s) [seg_pos={0 0}, upload=196499]: Begin upload segment...
Aug 16 14:16:18.017192346 (188h49m58.748459976s) [seg_pos={0 0}, upload=196499]: Done begin upload segment.
Aug 16 14:16:18.017219977 (188h49m58.748487608s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017238192 (188h49m58.748505822s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017530493 (188h49m58.748798123s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017683371 (188h49m58.748951001s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017822873 (188h49m58.749090503s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017954792 (188h49m58.749222412s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018071551 (188h49m58.749339181s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018297016 (188h49m58.749564646s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018334989 (188h49m58.749602609s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018565412 (188h49m58.749833042s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018588907 (188h49m58.749856527s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018774746 (188h49m58.750042367s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018844959 (188h49m58.750112589s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019032252 (188h49m58.750299882s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019167447 (188h49m58.750435087s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019301099 (188h49m58.750568738s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019571457 (188h49m58.750839138s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019602145 (188h49m58.750869785s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.115744005 (188h49m58.847011635s) [upload=196499]: Next returned nil segment
Aug 16 14:16:18.115754284 (188h49m58.847021904s) [upload=196499]: Waiting for error group managing segments...
Aug 16 14:16:18.130232519 (188h49m58.861500149s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.157122637 (188h49m58.888390268s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.162570830 (188h49m58.89383847s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.167405859 (188h49m58.898673499s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.194464054 (188h49m58.925731714s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.212933918 (188h49m58.944201568s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.251849571 (188h49m58.983117221s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.275167749 (188h49m59.00643541s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.295695371 (188h49m59.026963021s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.316649887 (188h49m59.047917537s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.328541508 (188h49m59.059809159s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.332228053 (188h49m59.063495704s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.670407611 (188h49m59.401675261s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944879583 (188h49m59.676147213s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944906283 (188h49m59.676173913s) [seg_pos={0 0}, upload=196499]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:16:18.945013435 (188h49m59.676281055s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945052779 (188h49m59.676320399s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945091341 (188h49m59.676358971s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945174177 (188h49m59.676441797s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection; write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection
Aug 16 14:16:18.945199235 (188h49m59.676466865s) [seg_pos={0 0}, upload=196499]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:16:18.945263225 (188h49m59.676530845s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:16:18.945267283 (188h49m59.676534903s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:16:20.002691068 (188h50m0.733958748s) [upload=196499]: Done uploading segments...
Aug 16 14:16:20.002716066 (188h50m0.733983715s) [upload=196499]: Upload finished. err: <nil>
Duration: 1.976500069s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
232.299193ms
FAIL (2025-08-16 14:16:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 232.326704ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
2.116075832s
FAIL (2025-08-16 14:16:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 14:16:17.941364946 (188h49m58.672632576s) [upload=196499]: Starting upload
Aug 16 14:16:17.941397227 (188h49m58.672664847s) [upload=196499]: Done starting upload
Aug 16 14:16:17.941500261 (188h49m58.672767891s) [upload=196499]: Uploading segments...
Aug 16 14:16:17.941625838 (188h49m58.672893459s) [upload=196499]: Got next segment. Inline: false
Aug 16 14:16:17.941656596 (188h49m58.672924216s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 14:16:17.941660253 (188h49m58.672927872s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 14:16:18.017152720 (188h49m58.748420351s) [seg_pos={0 0}, upload=196499]: Begin upload segment...
Aug 16 14:16:18.017192346 (188h49m58.748459976s) [seg_pos={0 0}, upload=196499]: Done begin upload segment.
Aug 16 14:16:18.017219977 (188h49m58.748487608s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017238192 (188h49m58.748505822s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017530493 (188h49m58.748798123s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017683371 (188h49m58.748951001s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017822873 (188h49m58.749090503s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.017954792 (188h49m58.749222412s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018071551 (188h49m58.749339181s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018297016 (188h49m58.749564646s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018334989 (188h49m58.749602609s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018565412 (188h49m58.749833042s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018588907 (188h49m58.749856527s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018774746 (188h49m58.750042367s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.018844959 (188h49m58.750112589s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019032252 (188h49m58.750299882s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019167447 (188h49m58.750435087s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019301099 (188h49m58.750568738s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019571457 (188h49m58.750839138s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.019602145 (188h49m58.750869785s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Uploading piece...
Aug 16 14:16:18.115744005 (188h49m58.847011635s) [upload=196499]: Next returned nil segment
Aug 16 14:16:18.115754284 (188h49m58.847021904s) [upload=196499]: Waiting for error group managing segments...
Aug 16 14:16:18.130232519 (188h49m58.861500149s) [noise=true , address=104.36.82.9:4025 , piece_id=WIOW2P2UAPGWWQV42ABRX6XYBT34F7SKMG7RLN2VPALVQIKKRXIA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.157122637 (188h49m58.888390268s) [noise=true , address=104.36.82.3:4799 , piece_id=CKLALIBFLZZSC3QUOF2WCJZPSLDARFX6XO3GHNWB6ZAJGIPRXNPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.162570830 (188h49m58.89383847s) [noise=true , address=104.36.82.18:4381 , piece_id=KS5STDXLZUBBKUABMBEI4HOQDIKZUAT5EPJJ4WVGARY2TR6UNMDA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.167405859 (188h49m58.898673499s) [noise=true , address=104.36.82.44:4892 , piece_id=ZRNUS6LJWBLBU5WRFZCL6VV34EXKXXFMODZZ4Z7EYJEN2UZI7OYA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.194464054 (188h49m58.925731714s) [noise=true , address=104.36.82.5:4846 , piece_id=KPUIKN5OVJO3MMMO6KKIEUVPCP7QCRTBW6SELEHMPEEWVIZSIZOQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.212933918 (188h49m58.944201568s) [noise=true , address=77.90.31.19:4863 , piece_id=HD563DQE6LRC4D6PAWAZKJWPVSLO7OHITQFVXOJHC4GLTI2CZZFA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.251849571 (188h49m58.983117221s) [noise=true , address=79.127.220.98:4419 , piece_id=EIEL4SNPF3IZEHIV2ZTWDH2RQWENDA4NCMAW3VQZJ7XQZQ4V2PHQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.275167749 (188h49m59.00643541s) [noise=true , address=77.90.31.13:4653 , piece_id=HNAAY7GCALIVDZCD3D2NP7YF734DCAZ7I4VVGIPVQGP6N2TJED5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.295695371 (188h49m59.026963021s) [noise=true , address=79.127.201.215:4343 , piece_id=SVOOBD63RGGQBSOWLC4YF2O3KKGLRVXBWWHCTUV62UJUPYXF7PWQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.316649887 (188h49m59.047917537s) [noise=true , address=45.91.116.7:4043 , piece_id=VI4YW52GVTLFGBFXPROEOTHAPUDSCIH24WSTN2IZHNTEV4KDQX5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.328541508 (188h49m59.059809159s) [noise=true , address=79.127.201.215:4353 , piece_id=P5VE6CRU4FNZ2FWAP6FWTSQC3BLSED2WUYDUTQCIBPEX5UWSRGNA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.332228053 (188h49m59.063495704s) [noise=true , address=104.36.82.38:4708 , piece_id=JCD3QTFKLTK7JQD3QE2BKXHO6MEOW746OOLRHNHC3FFDDG4WOIUA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.670407611 (188h49m59.401675261s) [noise=true , address=77.90.31.15:4715 , piece_id=L22P32XNME3AAUSQDD7HSZPRAFHSMTR2BF7FMB5PEHTAOPZ44IPQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944879583 (188h49m59.676147213s) [noise=true , address=104.36.82.60:4347 , piece_id=ZX6YU6KWOJHLLJ7ELJ7Y3EYFRKOPPCVNDN2WRMPS255TNICHKN5A, seg_pos={0 0}, upload=196499]: Done uploading piece. err: <nil>
Aug 16 14:16:18.944906283 (188h49m59.676173913s) [seg_pos={0 0}, upload=196499]: Segment reached optimal threshold of 14 pieces.
Aug 16 14:16:18.945013435 (188h49m59.676281055s) [noise=true , address=66.23.193.175:4558 , piece_id=DVHKVDFQVEFUDXMBHJZIGQQX2V6AFA6D7Q7FOYQAKGEE4HTMG2OQ, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Zuge4ehe7qFQQnBuZpifoLeKQ9vxstvg5BwKjJ1KhsxCqp4TB): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945052779 (188h49m59.676320399s) [noise=true , address=104.36.82.36:4622 , piece_id=6AOGL277I7GTCKMGTCI6PBPL2ROCAKIDI535XXV4MAQ2HKSJLD4Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945091341 (188h49m59.676358971s) [noise=true , address=104.36.82.39:4747 , piece_id=RG6YCINJ7BM6IGP66GNDN7HAZVMAWFYVDLJB5RQ5AC7SKXGLOEPA, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: expected piece hash; context canceled; EOF
Aug 16 14:16:18.945174177 (188h49m59.676441797s) [noise=true , address=104.36.82.23:4476 , piece_id=WBHIKYEEIJBAGR6ZAIFZGVTY7PNOCBZ66Y5AX524N2NS2FAAAF5Q, seg_pos={0 0}, upload=196499]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foWwyGzFenUicfY7cTU5dmdDJsvXGR3YXv1rf3QRXMUco59TV): protocol: write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection; write tcp 5.161.89.252:63312->104.36.82.23:4476: use of closed network connection
Aug 16 14:16:18.945199235 (188h49m59.676466865s) [seg_pos={0 0}, upload=196499]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 14:16:18.945263225 (188h49m59.676530845s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 14:16:18.945267283 (188h49m59.676534903s) [upload=196499]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 14:16:20.002691068 (188h50m0.733958748s) [upload=196499]: Done uploading segments...
Aug 16 14:16:20.002716066 (188h50m0.733983715s) [upload=196499]: Upload finished. err: <nil>
Duration: 2.116098455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.029984628s
FAIL (2025-08-16 14:15:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.030006969s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
281.075284ms
FAIL (2025-08-16 14:14:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 281.105742ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
800.732966ms
FAIL (2025-08-16 14:14:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 800.771868ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.426284059s
FAIL (2025-08-16 14:13:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.426304647s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.006246755s
FAIL (2025-08-16 14:12:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.006264429s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.362451025s
FAIL (2025-08-16 14:11:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.362487403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
3.175222963s
FAIL (2025-08-16 14:11:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.175240546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.985630839s
FAIL (2025-08-16 14:10:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 13:50:46.600500552 (188h24m27.331768201s) [upload=196066]: Starting upload Aug 16 13:50:46.600564882 (188h24m27.331832533s) [upload=196066]: Done starting upload Aug 16 13:50:46.600633151 (188h24m27.3319008s) [upload=196066]: Uploading segments... Aug 16 13:50:46.600668738 (188h24m27.331936388s) [upload=196066]: Got next segment. Inline: true Aug 16 13:50:46.600673868 (188h24m27.331941518s) [upload=196066]: Waiting for error group managing segments... Aug 16 13:50:46.600715095 (188h24m27.331982735s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 13:50:46.600720134 (188h24m27.331987785s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 13:50:46.600723430 (188h24m27.331991081s) [upload=196066]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 13:50:46.602451737 (188h24m27.333719377s) [upload=196066]: Done uploading segments... Aug 16 13:50:46.602460985 (188h24m27.333728625s) [upload=196066]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.985655837s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|