Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X.........................X........X..X........X.....] duration:
216.772434ms
FAIL (2025-08-28 09:43:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 28 09:39:18.778367010 (16h0m42.007852378s) [upload=16592]: Starting upload Aug 28 09:39:18.778456608 (16h0m42.007941996s) [upload=16592]: Done starting upload Aug 28 09:39:18.778540948 (16h0m42.008026325s) [upload=16592]: Uploading segments... Aug 28 09:39:18.778581344 (16h0m42.00806672s) [upload=16592]: Got next segment. Inline: true Aug 28 09:39:18.778586603 (16h0m42.00807198s) [upload=16592]: Waiting for error group managing segments... Aug 28 09:39:18.778627780 (16h0m42.008113158s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:39:18.778632790 (16h0m42.008118167s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:39:18.778635956 (16h0m42.008121323s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:39:18.840977720 (16h0m42.070463067s) [upload=16592]: Done uploading segments... Aug 28 09:39:18.840992998 (16h0m42.070478355s) [upload=16592]: Upload finished. err: <nil>
Duration: 216.794465ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X.........................X........X..X........X....] duration:
127.071891ms
FAIL (2025-08-28 09:42:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 28 09:39:18.778367010 (16h0m42.007852378s) [upload=16592]: Starting upload Aug 28 09:39:18.778456608 (16h0m42.007941996s) [upload=16592]: Done starting upload Aug 28 09:39:18.778540948 (16h0m42.008026325s) [upload=16592]: Uploading segments... Aug 28 09:39:18.778581344 (16h0m42.00806672s) [upload=16592]: Got next segment. Inline: true Aug 28 09:39:18.778586603 (16h0m42.00807198s) [upload=16592]: Waiting for error group managing segments... Aug 28 09:39:18.778627780 (16h0m42.008113158s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:39:18.778632790 (16h0m42.008118167s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:39:18.778635956 (16h0m42.008121323s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:39:18.840977720 (16h0m42.070463067s) [upload=16592]: Done uploading segments... Aug 28 09:39:18.840992998 (16h0m42.070478355s) [upload=16592]: Upload finished. err: <nil>
Duration: 127.09778ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X.........................X........X..X........X...] duration:
131.664141ms
FAIL (2025-08-28 09:41:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 28 09:39:18.778367010 (16h0m42.007852378s) [upload=16592]: Starting upload Aug 28 09:39:18.778456608 (16h0m42.007941996s) [upload=16592]: Done starting upload Aug 28 09:39:18.778540948 (16h0m42.008026325s) [upload=16592]: Uploading segments... Aug 28 09:39:18.778581344 (16h0m42.00806672s) [upload=16592]: Got next segment. Inline: true Aug 28 09:39:18.778586603 (16h0m42.00807198s) [upload=16592]: Waiting for error group managing segments... Aug 28 09:39:18.778627780 (16h0m42.008113158s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:39:18.778632790 (16h0m42.008118167s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:39:18.778635956 (16h0m42.008121323s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:39:18.840977720 (16h0m42.070463067s) [upload=16592]: Done uploading segments... Aug 28 09:39:18.840992998 (16h0m42.070478355s) [upload=16592]: Upload finished. err: <nil>
Duration: 131.68985ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X.........................X........X..X........X..] duration:
261.819044ms
FAIL (2025-08-28 09:40:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 28 09:39:18.778367010 (16h0m42.007852378s) [upload=16592]: Starting upload Aug 28 09:39:18.778456608 (16h0m42.007941996s) [upload=16592]: Done starting upload Aug 28 09:39:18.778540948 (16h0m42.008026325s) [upload=16592]: Uploading segments... Aug 28 09:39:18.778581344 (16h0m42.00806672s) [upload=16592]: Got next segment. Inline: true Aug 28 09:39:18.778586603 (16h0m42.00807198s) [upload=16592]: Waiting for error group managing segments... Aug 28 09:39:18.778627780 (16h0m42.008113158s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:39:18.778632790 (16h0m42.008118167s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:39:18.778635956 (16h0m42.008121323s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:39:18.840977720 (16h0m42.070463067s) [upload=16592]: Done uploading segments... Aug 28 09:39:18.840992998 (16h0m42.070478355s) [upload=16592]: Upload finished. err: <nil>
Duration: 261.844451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X.........................X........X..X........X.] duration:
174.080988ms
FAIL (2025-08-28 09:39:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 28 09:39:18.778367010 (16h0m42.007852378s) [upload=16592]: Starting upload Aug 28 09:39:18.778456608 (16h0m42.007941996s) [upload=16592]: Done starting upload Aug 28 09:39:18.778540948 (16h0m42.008026325s) [upload=16592]: Uploading segments... Aug 28 09:39:18.778581344 (16h0m42.00806672s) [upload=16592]: Got next segment. Inline: true Aug 28 09:39:18.778586603 (16h0m42.00807198s) [upload=16592]: Waiting for error group managing segments... Aug 28 09:39:18.778627780 (16h0m42.008113158s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:39:18.778632790 (16h0m42.008118167s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:39:18.778635956 (16h0m42.008121323s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:39:18.840977720 (16h0m42.070463067s) [upload=16592]: Done uploading segments... Aug 28 09:39:18.840992998 (16h0m42.070478355s) [upload=16592]: Upload finished. err: <nil>
Duration: 174.106186ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X.........................X........X..X........X] duration:
121.178032ms
FAIL (2025-08-28 09:39:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 28 09:39:18.778367010 (16h0m42.007852378s) [upload=16592]: Starting upload Aug 28 09:39:18.778456608 (16h0m42.007941996s) [upload=16592]: Done starting upload Aug 28 09:39:18.778540948 (16h0m42.008026325s) [upload=16592]: Uploading segments... Aug 28 09:39:18.778581344 (16h0m42.00806672s) [upload=16592]: Got next segment. Inline: true Aug 28 09:39:18.778586603 (16h0m42.00807198s) [upload=16592]: Waiting for error group managing segments... Aug 28 09:39:18.778627780 (16h0m42.008113158s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:39:18.778632790 (16h0m42.008118167s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:39:18.778635956 (16h0m42.008121323s) [upload=16592]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:39:18.840977720 (16h0m42.070463067s) [upload=16592]: Done uploading segments... Aug 28 09:39:18.840992998 (16h0m42.070478355s) [upload=16592]: Upload finished. err: <nil>
Duration: 121.229869ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.........................X........X..X........] duration:
175.251048ms
FAIL (2025-08-28 09:38:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:33:37.472798845 (15h55m0.702284192s) [upload=16488]: Starting upload Aug 28 09:33:37.472877142 (15h55m0.702362489s) [upload=16488]: Done starting upload Aug 28 09:33:37.472927968 (15h55m0.702413325s) [upload=16488]: Uploading segments... Aug 28 09:33:37.473009090 (15h55m0.702494458s) [upload=16488]: Got next segment. Inline: true Aug 28 09:33:37.473016544 (15h55m0.702501901s) [upload=16488]: Waiting for error group managing segments... Aug 28 09:33:37.473063252 (15h55m0.702548629s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:33:37.473069173 (15h55m0.70255452s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:33:37.473073410 (15h55m0.702558768s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:33:37.475886123 (15h55m0.70537148s) [upload=16488]: Done uploading segments... Aug 28 09:33:37.475893688 (15h55m0.705379034s) [upload=16488]: Upload finished. err: metaclient: Too Many Requests
Duration: 175.277788ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.........................X........X..X.......] duration:
159.431005ms
FAIL (2025-08-28 09:38:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:33:37.472798845 (15h55m0.702284192s) [upload=16488]: Starting upload Aug 28 09:33:37.472877142 (15h55m0.702362489s) [upload=16488]: Done starting upload Aug 28 09:33:37.472927968 (15h55m0.702413325s) [upload=16488]: Uploading segments... Aug 28 09:33:37.473009090 (15h55m0.702494458s) [upload=16488]: Got next segment. Inline: true Aug 28 09:33:37.473016544 (15h55m0.702501901s) [upload=16488]: Waiting for error group managing segments... Aug 28 09:33:37.473063252 (15h55m0.702548629s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:33:37.473069173 (15h55m0.70255452s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:33:37.473073410 (15h55m0.702558768s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:33:37.475886123 (15h55m0.70537148s) [upload=16488]: Done uploading segments... Aug 28 09:33:37.475893688 (15h55m0.705379034s) [upload=16488]: Upload finished. err: metaclient: Too Many Requests
Duration: 159.453897ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X.........................X........X..X......] duration:
123.219743ms
FAIL (2025-08-28 09:37:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:33:37.472798845 (15h55m0.702284192s) [upload=16488]: Starting upload Aug 28 09:33:37.472877142 (15h55m0.702362489s) [upload=16488]: Done starting upload Aug 28 09:33:37.472927968 (15h55m0.702413325s) [upload=16488]: Uploading segments... Aug 28 09:33:37.473009090 (15h55m0.702494458s) [upload=16488]: Got next segment. Inline: true Aug 28 09:33:37.473016544 (15h55m0.702501901s) [upload=16488]: Waiting for error group managing segments... Aug 28 09:33:37.473063252 (15h55m0.702548629s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:33:37.473069173 (15h55m0.70255452s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:33:37.473073410 (15h55m0.702558768s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:33:37.475886123 (15h55m0.70537148s) [upload=16488]: Done uploading segments... Aug 28 09:33:37.475893688 (15h55m0.705379034s) [upload=16488]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.248347ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X.........................X........X..X.....] duration:
437.309852ms
FAIL (2025-08-28 09:36:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:33:37.472798845 (15h55m0.702284192s) [upload=16488]: Starting upload Aug 28 09:33:37.472877142 (15h55m0.702362489s) [upload=16488]: Done starting upload Aug 28 09:33:37.472927968 (15h55m0.702413325s) [upload=16488]: Uploading segments... Aug 28 09:33:37.473009090 (15h55m0.702494458s) [upload=16488]: Got next segment. Inline: true Aug 28 09:33:37.473016544 (15h55m0.702501901s) [upload=16488]: Waiting for error group managing segments... Aug 28 09:33:37.473063252 (15h55m0.702548629s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:33:37.473069173 (15h55m0.70255452s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:33:37.473073410 (15h55m0.702558768s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:33:37.475886123 (15h55m0.70537148s) [upload=16488]: Done uploading segments... Aug 28 09:33:37.475893688 (15h55m0.705379034s) [upload=16488]: Upload finished. err: metaclient: Too Many Requests
Duration: 437.332206ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X.........................X........X..X....] duration:
383.657585ms
FAIL (2025-08-28 09:36:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:33:37.472798845 (15h55m0.702284192s) [upload=16488]: Starting upload Aug 28 09:33:37.472877142 (15h55m0.702362489s) [upload=16488]: Done starting upload Aug 28 09:33:37.472927968 (15h55m0.702413325s) [upload=16488]: Uploading segments... Aug 28 09:33:37.473009090 (15h55m0.702494458s) [upload=16488]: Got next segment. Inline: true Aug 28 09:33:37.473016544 (15h55m0.702501901s) [upload=16488]: Waiting for error group managing segments... Aug 28 09:33:37.473063252 (15h55m0.702548629s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:33:37.473069173 (15h55m0.70255452s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:33:37.473073410 (15h55m0.702558768s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:33:37.475886123 (15h55m0.70537148s) [upload=16488]: Done uploading segments... Aug 28 09:33:37.475893688 (15h55m0.705379034s) [upload=16488]: Upload finished. err: metaclient: Too Many Requests
Duration: 383.719673ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X.........................X........X..X...] duration:
118.386049ms
FAIL (2025-08-28 09:35:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:33:37.472798845 (15h55m0.702284192s) [upload=16488]: Starting upload Aug 28 09:33:37.472877142 (15h55m0.702362489s) [upload=16488]: Done starting upload Aug 28 09:33:37.472927968 (15h55m0.702413325s) [upload=16488]: Uploading segments... Aug 28 09:33:37.473009090 (15h55m0.702494458s) [upload=16488]: Got next segment. Inline: true Aug 28 09:33:37.473016544 (15h55m0.702501901s) [upload=16488]: Waiting for error group managing segments... Aug 28 09:33:37.473063252 (15h55m0.702548629s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:33:37.473069173 (15h55m0.70255452s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:33:37.473073410 (15h55m0.702558768s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:33:37.475886123 (15h55m0.70537148s) [upload=16488]: Done uploading segments... Aug 28 09:33:37.475893688 (15h55m0.705379034s) [upload=16488]: Upload finished. err: metaclient: Too Many Requests
Duration: 118.427497ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X.........................X........X..X..] duration:
136.385283ms
FAIL (2025-08-28 09:35:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:33:37.472798845 (15h55m0.702284192s) [upload=16488]: Starting upload Aug 28 09:33:37.472877142 (15h55m0.702362489s) [upload=16488]: Done starting upload Aug 28 09:33:37.472927968 (15h55m0.702413325s) [upload=16488]: Uploading segments... Aug 28 09:33:37.473009090 (15h55m0.702494458s) [upload=16488]: Got next segment. Inline: true Aug 28 09:33:37.473016544 (15h55m0.702501901s) [upload=16488]: Waiting for error group managing segments... Aug 28 09:33:37.473063252 (15h55m0.702548629s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:33:37.473069173 (15h55m0.70255452s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:33:37.473073410 (15h55m0.702558768s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:33:37.475886123 (15h55m0.70537148s) [upload=16488]: Done uploading segments... Aug 28 09:33:37.475893688 (15h55m0.705379034s) [upload=16488]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.413616ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X.........................X........X..X.] duration:
133.535794ms
FAIL (2025-08-28 09:34:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:33:37.472798845 (15h55m0.702284192s) [upload=16488]: Starting upload Aug 28 09:33:37.472877142 (15h55m0.702362489s) [upload=16488]: Done starting upload Aug 28 09:33:37.472927968 (15h55m0.702413325s) [upload=16488]: Uploading segments... Aug 28 09:33:37.473009090 (15h55m0.702494458s) [upload=16488]: Got next segment. Inline: true Aug 28 09:33:37.473016544 (15h55m0.702501901s) [upload=16488]: Waiting for error group managing segments... Aug 28 09:33:37.473063252 (15h55m0.702548629s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:33:37.473069173 (15h55m0.70255452s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:33:37.473073410 (15h55m0.702558768s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:33:37.475886123 (15h55m0.70537148s) [upload=16488]: Done uploading segments... Aug 28 09:33:37.475893688 (15h55m0.705379034s) [upload=16488]: Upload finished. err: metaclient: Too Many Requests
Duration: 133.564199ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.........................X........X..X] duration:
14.396947ms
FAIL (2025-08-28 09:33:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:33:37.472798845 (15h55m0.702284192s) [upload=16488]: Starting upload Aug 28 09:33:37.472877142 (15h55m0.702362489s) [upload=16488]: Done starting upload Aug 28 09:33:37.472927968 (15h55m0.702413325s) [upload=16488]: Uploading segments... Aug 28 09:33:37.473009090 (15h55m0.702494458s) [upload=16488]: Got next segment. Inline: true Aug 28 09:33:37.473016544 (15h55m0.702501901s) [upload=16488]: Waiting for error group managing segments... Aug 28 09:33:37.473063252 (15h55m0.702548629s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:33:37.473069173 (15h55m0.70255452s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:33:37.473073410 (15h55m0.702558768s) [upload=16488]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:33:37.475886123 (15h55m0.70537148s) [upload=16488]: Done uploading segments... Aug 28 09:33:37.475893688 (15h55m0.705379034s) [upload=16488]: Upload finished. err: metaclient: Too Many Requests
Duration: 14.407576ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X.........................X........X..] duration:
224.787328ms
FAIL (2025-08-28 09:32:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:30:14.777026842 (15h51m38.006512219s) [upload=16430]: Starting upload Aug 28 09:30:14.777101253 (15h51m38.00658663s) [upload=16430]: Done starting upload Aug 28 09:30:14.777161115 (15h51m38.006646492s) [upload=16430]: Uploading segments... Aug 28 09:30:14.777211911 (15h51m38.006697287s) [upload=16430]: Got next segment. Inline: true Aug 28 09:30:14.777218514 (15h51m38.006703891s) [upload=16430]: Waiting for error group managing segments... Aug 28 09:30:14.777262857 (15h51m38.006748234s) [upload=16430]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:30:14.777268217 (15h51m38.006753594s) [upload=16430]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:30:14.777271463 (15h51m38.00675683s) [upload=16430]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:30:14.780995861 (15h51m38.010481237s) [upload=16430]: Done uploading segments... Aug 28 09:30:14.781006521 (15h51m38.010491897s) [upload=16430]: Upload finished. err: metaclient: Too Many Requests
Duration: 224.811164ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.........................X........X.] duration:
132.141206ms
FAIL (2025-08-28 09:31:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:30:14.777026842 (15h51m38.006512219s) [upload=16430]: Starting upload Aug 28 09:30:14.777101253 (15h51m38.00658663s) [upload=16430]: Done starting upload Aug 28 09:30:14.777161115 (15h51m38.006646492s) [upload=16430]: Uploading segments... Aug 28 09:30:14.777211911 (15h51m38.006697287s) [upload=16430]: Got next segment. Inline: true Aug 28 09:30:14.777218514 (15h51m38.006703891s) [upload=16430]: Waiting for error group managing segments... Aug 28 09:30:14.777262857 (15h51m38.006748234s) [upload=16430]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:30:14.777268217 (15h51m38.006753594s) [upload=16430]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:30:14.777271463 (15h51m38.00675683s) [upload=16430]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:30:14.780995861 (15h51m38.010481237s) [upload=16430]: Done uploading segments... Aug 28 09:30:14.781006521 (15h51m38.010491897s) [upload=16430]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.16464ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.........................X........X] duration:
19.99991ms
FAIL (2025-08-28 09:30:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:30:14.777026842 (15h51m38.006512219s) [upload=16430]: Starting upload Aug 28 09:30:14.777101253 (15h51m38.00658663s) [upload=16430]: Done starting upload Aug 28 09:30:14.777161115 (15h51m38.006646492s) [upload=16430]: Uploading segments... Aug 28 09:30:14.777211911 (15h51m38.006697287s) [upload=16430]: Got next segment. Inline: true Aug 28 09:30:14.777218514 (15h51m38.006703891s) [upload=16430]: Waiting for error group managing segments... Aug 28 09:30:14.777262857 (15h51m38.006748234s) [upload=16430]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:30:14.777268217 (15h51m38.006753594s) [upload=16430]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:30:14.777271463 (15h51m38.00675683s) [upload=16430]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:30:14.780995861 (15h51m38.010481237s) [upload=16430]: Done uploading segments... Aug 28 09:30:14.781006521 (15h51m38.010491897s) [upload=16430]: Upload finished. err: metaclient: Too Many Requests
Duration: 20.019206ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.........................X........] duration:
128.96342ms
FAIL (2025-08-28 09:29:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:23:31.047787676 (15h44m54.277273033s) [upload=16315]: Starting upload Aug 28 09:23:31.047828734 (15h44m54.277314091s) [upload=16315]: Done starting upload Aug 28 09:23:31.047869349 (15h44m54.277354697s) [upload=16315]: Uploading segments... Aug 28 09:23:31.047898314 (15h44m54.277383661s) [upload=16315]: Got next segment. Inline: true Aug 28 09:23:31.047902121 (15h44m54.277387468s) [upload=16315]: Waiting for error group managing segments... Aug 28 09:23:31.047952336 (15h44m54.277437693s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:23:31.047956304 (15h44m54.277441661s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:23:31.047958688 (15h44m54.277444045s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:23:31.049818998 (15h44m54.279304356s) [upload=16315]: Done uploading segments... Aug 28 09:23:31.049826562 (15h44m54.279311919s) [upload=16315]: Upload finished. err: metaclient: Too Many Requests
Duration: 129.023391ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.........................X.......] duration:
126.865158ms
FAIL (2025-08-28 09:29:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:23:31.047787676 (15h44m54.277273033s) [upload=16315]: Starting upload Aug 28 09:23:31.047828734 (15h44m54.277314091s) [upload=16315]: Done starting upload Aug 28 09:23:31.047869349 (15h44m54.277354697s) [upload=16315]: Uploading segments... Aug 28 09:23:31.047898314 (15h44m54.277383661s) [upload=16315]: Got next segment. Inline: true Aug 28 09:23:31.047902121 (15h44m54.277387468s) [upload=16315]: Waiting for error group managing segments... Aug 28 09:23:31.047952336 (15h44m54.277437693s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:23:31.047956304 (15h44m54.277441661s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:23:31.047958688 (15h44m54.277444045s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:23:31.049818998 (15h44m54.279304356s) [upload=16315]: Done uploading segments... Aug 28 09:23:31.049826562 (15h44m54.279311919s) [upload=16315]: Upload finished. err: metaclient: Too Many Requests
Duration: 126.890858ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.........................X......] duration:
132.374304ms
FAIL (2025-08-28 09:28:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:23:31.047787676 (15h44m54.277273033s) [upload=16315]: Starting upload Aug 28 09:23:31.047828734 (15h44m54.277314091s) [upload=16315]: Done starting upload Aug 28 09:23:31.047869349 (15h44m54.277354697s) [upload=16315]: Uploading segments... Aug 28 09:23:31.047898314 (15h44m54.277383661s) [upload=16315]: Got next segment. Inline: true Aug 28 09:23:31.047902121 (15h44m54.277387468s) [upload=16315]: Waiting for error group managing segments... Aug 28 09:23:31.047952336 (15h44m54.277437693s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:23:31.047956304 (15h44m54.277441661s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:23:31.047958688 (15h44m54.277444045s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:23:31.049818998 (15h44m54.279304356s) [upload=16315]: Done uploading segments... Aug 28 09:23:31.049826562 (15h44m54.279311919s) [upload=16315]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.40399ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.........................X.....] duration:
256.575742ms
FAIL (2025-08-28 09:27:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:23:31.047787676 (15h44m54.277273033s) [upload=16315]: Starting upload Aug 28 09:23:31.047828734 (15h44m54.277314091s) [upload=16315]: Done starting upload Aug 28 09:23:31.047869349 (15h44m54.277354697s) [upload=16315]: Uploading segments... Aug 28 09:23:31.047898314 (15h44m54.277383661s) [upload=16315]: Got next segment. Inline: true Aug 28 09:23:31.047902121 (15h44m54.277387468s) [upload=16315]: Waiting for error group managing segments... Aug 28 09:23:31.047952336 (15h44m54.277437693s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:23:31.047956304 (15h44m54.277441661s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:23:31.047958688 (15h44m54.277444045s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:23:31.049818998 (15h44m54.279304356s) [upload=16315]: Done uploading segments... Aug 28 09:23:31.049826562 (15h44m54.279311919s) [upload=16315]: Upload finished. err: metaclient: Too Many Requests
Duration: 256.595109ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.........................X....] duration:
135.683172ms
FAIL (2025-08-28 09:26:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:23:31.047787676 (15h44m54.277273033s) [upload=16315]: Starting upload Aug 28 09:23:31.047828734 (15h44m54.277314091s) [upload=16315]: Done starting upload Aug 28 09:23:31.047869349 (15h44m54.277354697s) [upload=16315]: Uploading segments... Aug 28 09:23:31.047898314 (15h44m54.277383661s) [upload=16315]: Got next segment. Inline: true Aug 28 09:23:31.047902121 (15h44m54.277387468s) [upload=16315]: Waiting for error group managing segments... Aug 28 09:23:31.047952336 (15h44m54.277437693s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:23:31.047956304 (15h44m54.277441661s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:23:31.047958688 (15h44m54.277444045s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:23:31.049818998 (15h44m54.279304356s) [upload=16315]: Done uploading segments... Aug 28 09:23:31.049826562 (15h44m54.279311919s) [upload=16315]: Upload finished. err: metaclient: Too Many Requests
Duration: 135.710985ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.........................X...] duration:
140.066657ms
FAIL (2025-08-28 09:25:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:23:31.047787676 (15h44m54.277273033s) [upload=16315]: Starting upload Aug 28 09:23:31.047828734 (15h44m54.277314091s) [upload=16315]: Done starting upload Aug 28 09:23:31.047869349 (15h44m54.277354697s) [upload=16315]: Uploading segments... Aug 28 09:23:31.047898314 (15h44m54.277383661s) [upload=16315]: Got next segment. Inline: true Aug 28 09:23:31.047902121 (15h44m54.277387468s) [upload=16315]: Waiting for error group managing segments... Aug 28 09:23:31.047952336 (15h44m54.277437693s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:23:31.047956304 (15h44m54.277441661s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:23:31.047958688 (15h44m54.277444045s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:23:31.049818998 (15h44m54.279304356s) [upload=16315]: Done uploading segments... Aug 28 09:23:31.049826562 (15h44m54.279311919s) [upload=16315]: Upload finished. err: metaclient: Too Many Requests
Duration: 140.086024ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.........................X..] duration:
160.301411ms
FAIL (2025-08-28 09:25:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:23:31.047787676 (15h44m54.277273033s) [upload=16315]: Starting upload Aug 28 09:23:31.047828734 (15h44m54.277314091s) [upload=16315]: Done starting upload Aug 28 09:23:31.047869349 (15h44m54.277354697s) [upload=16315]: Uploading segments... Aug 28 09:23:31.047898314 (15h44m54.277383661s) [upload=16315]: Got next segment. Inline: true Aug 28 09:23:31.047902121 (15h44m54.277387468s) [upload=16315]: Waiting for error group managing segments... Aug 28 09:23:31.047952336 (15h44m54.277437693s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:23:31.047956304 (15h44m54.277441661s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:23:31.047958688 (15h44m54.277444045s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:23:31.049818998 (15h44m54.279304356s) [upload=16315]: Done uploading segments... Aug 28 09:23:31.049826562 (15h44m54.279311919s) [upload=16315]: Upload finished. err: metaclient: Too Many Requests
Duration: 160.335514ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X.........................X.] duration:
151.970024ms
FAIL (2025-08-28 09:24:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:23:31.047787676 (15h44m54.277273033s) [upload=16315]: Starting upload Aug 28 09:23:31.047828734 (15h44m54.277314091s) [upload=16315]: Done starting upload Aug 28 09:23:31.047869349 (15h44m54.277354697s) [upload=16315]: Uploading segments... Aug 28 09:23:31.047898314 (15h44m54.277383661s) [upload=16315]: Got next segment. Inline: true Aug 28 09:23:31.047902121 (15h44m54.277387468s) [upload=16315]: Waiting for error group managing segments... Aug 28 09:23:31.047952336 (15h44m54.277437693s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:23:31.047956304 (15h44m54.277441661s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:23:31.047958688 (15h44m54.277444045s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:23:31.049818998 (15h44m54.279304356s) [upload=16315]: Done uploading segments... Aug 28 09:23:31.049826562 (15h44m54.279311919s) [upload=16315]: Upload finished. err: metaclient: Too Many Requests
Duration: 151.996243ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X.........................X] duration:
14.431962ms
FAIL (2025-08-28 09:23:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:23:31.047787676 (15h44m54.277273033s) [upload=16315]: Starting upload Aug 28 09:23:31.047828734 (15h44m54.277314091s) [upload=16315]: Done starting upload Aug 28 09:23:31.047869349 (15h44m54.277354697s) [upload=16315]: Uploading segments... Aug 28 09:23:31.047898314 (15h44m54.277383661s) [upload=16315]: Got next segment. Inline: true Aug 28 09:23:31.047902121 (15h44m54.277387468s) [upload=16315]: Waiting for error group managing segments... Aug 28 09:23:31.047952336 (15h44m54.277437693s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:23:31.047956304 (15h44m54.277441661s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:23:31.047958688 (15h44m54.277444045s) [upload=16315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:23:31.049818998 (15h44m54.279304356s) [upload=16315]: Done uploading segments... Aug 28 09:23:31.049826562 (15h44m54.279311919s) [upload=16315]: Upload finished. err: metaclient: Too Many Requests
Duration: 14.447963ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
602.443074ms
FAIL (2025-08-28 09:23:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 602.470186ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
132.521706ms
FAIL (2025-08-28 09:22:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.547155ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
461.763849ms
FAIL (2025-08-28 09:22:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 461.77976ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
495.835434ms
FAIL (2025-08-28 09:22:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 495.957875ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
123.752848ms
FAIL (2025-08-28 09:22:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.84955ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
604.993919ms
FAIL (2025-08-28 09:21:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 605.014687ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
395.285397ms
FAIL (2025-08-28 09:21:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 395.311375ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
147.309587ms
FAIL (2025-08-28 09:21:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.338461ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.249102333s
FAIL (2025-08-28 09:20:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 1.24913728s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
118.160224ms
FAIL (2025-08-28 09:19:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 118.187545ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
323.253115ms
FAIL (2025-08-28 09:19:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 323.278071ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
153.264021ms
FAIL (2025-08-28 09:18:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.28552ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
721.167691ms
FAIL (2025-08-28 09:18:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 721.191454ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
199.780455ms
FAIL (2025-08-28 09:18:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 199.800463ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
123.787091ms
FAIL (2025-08-28 09:18:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.812147ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
451.359493ms
FAIL (2025-08-28 09:17:51 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 451.3839ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X........................................X..................] duration:
127.885192ms
FAIL (2025-08-28 09:17:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 127.922082ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
545.441229ms
FAIL (2025-08-28 09:16:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 545.474042ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X........................................X.................] duration:
121.820672ms
FAIL (2025-08-28 09:16:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 121.849966ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
544.306775ms
FAIL (2025-08-28 09:16:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 544.338355ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X........................................X................] duration:
129.058971ms
FAIL (2025-08-28 09:16:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 129.090921ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
618.314914ms
FAIL (2025-08-28 09:15:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 08:38:37.128306418 (15h0m0.357791765s) [upload=15529]: Starting upload
Aug 28 08:38:37.128360960 (15h0m0.357846337s) [upload=15529]: Done starting upload
Aug 28 08:38:37.128467872 (15h0m0.357953229s) [upload=15529]: Uploading segments...
Aug 28 08:38:37.128594138 (15h0m0.358079495s) [upload=15529]: Got next segment. Inline: false
Aug 28 08:38:37.128626190 (15h0m0.358111547s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 08:38:37.128629987 (15h0m0.358115344s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 08:38:37.159496629 (15h0m0.388981986s) [seg_pos={0 0}, upload=15529]: Begin upload segment...
Aug 28 08:38:37.159526065 (15h0m0.389011422s) [seg_pos={0 0}, upload=15529]: Done begin upload segment.
Aug 28 08:38:37.159544059 (15h0m0.389029405s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159555029 (15h0m0.389040386s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159875983 (15h0m0.38936136s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.159904587 (15h0m0.389389934s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160272919 (15h0m0.389758276s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160280884 (15h0m0.389766242s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160535985 (15h0m0.390021342s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160629981 (15h0m0.390115338s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160761228 (15h0m0.390246585s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.160977334 (15h0m0.390462691s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161002733 (15h0m0.39048808s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161239779 (15h0m0.390725136s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161300903 (15h0m0.39078625s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161464060 (15h0m0.390949417s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161574097 (15h0m0.391059455s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161686059 (15h0m0.391171406s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161857702 (15h0m0.391343049s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.161951357 (15h0m0.391436705s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Uploading piece...
Aug 28 08:38:37.244154623 (15h0m0.47363998s) [upload=15529]: Next returned nil segment
Aug 28 08:38:37.244168008 (15h0m0.473653365s) [upload=15529]: Waiting for error group managing segments...
Aug 28 08:38:37.251633303 (15h0m0.481118651s) [noise=true , address=77.90.31.17:4785 , piece_id=LYRNYQXB2INNJ7VMBITLJRGD23EYWA4FAFBJNSD4FMV7MHZ4KVQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.252355692 (15h0m0.48184104s) [noise=true , address=79.127.219.51:4212 , piece_id=YVZW6FSYUM23DMNTWJLFXM74AS23CQIYGUOJK5GEFAY2PYML4XZA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253551001 (15h0m0.483036348s) [noise=true , address=79.127.219.47:4061 , piece_id=ROJ5OKOHYPBMZ7AEIGSSAFGO55AUGXPOKKO3NLNS6UU3MNDPADIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253716342 (15h0m0.483201699s) [noise=true , address=77.90.31.10:4540 , piece_id=BE6IXJD3GRIPVGCS4HP64GJQGFOGAGJY7YWPUMEIQWXP5CJVWOEQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.253854362 (15h0m0.483339699s) [noise=true , address=77.90.31.15:4708 , piece_id=67OFSU7ATITDJGLFX725R6FCDPL5ZCOUB7PXPQZ5QH67NTVC4RQA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254242262 (15h0m0.483727619s) [noise=true , address=77.90.31.12:4624 , piece_id=DPZHJKQXJPJ5HEGTNFXZFKWBV3IKWIIUDGNC5SSCDGULJ2TM2LKQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254362789 (15h0m0.483848136s) [noise=true , address=45.91.116.10:4107 , piece_id=N6GPEFOGPV7E54VUWEFMK2PSCHO5BYLCFVAKQFWY2BJ5XCDEVX2Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.254648477 (15h0m0.484133824s) [noise=true , address=45.91.116.12:4242 , piece_id=PRK3AVTCTLNTJS43DODHU67PGBYRWTVYHD3JGTD535DBARN2L33A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.255754988 (15h0m0.485240345s) [noise=true , address=77.90.31.11:4577 , piece_id=QDD5ZM4RV2EU3O356V2WOZWJVN3XNNQ5HUBG6Y3PNVVX4KD7BLAQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.260723024 (15h0m0.490208372s) [noise=true , address=104.36.82.5:4854 , piece_id=RQA77KC2PBWTWUX4N4PNFA4WT2EVBZHLENRU2CLQRNPZ2Z7BD56A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.263272761 (15h0m0.492758118s) [noise=true , address=77.90.31.21:4889 , piece_id=HHSZIXZFHY6NXFA6A2VCT7MEZL32KJWRKQ4YPTIVCUSQNC3OUBLQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272821166 (15h0m0.502306513s) [noise=true , address=77.90.31.16:4748 , piece_id=RHTMADW2SQ3WCXZQRNHLRKQ6STY5VTVFPDCHZ2WQD6KDFDWKKPIA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.272952033 (15h0m0.5024374s) [noise=true , address=45.91.116.4:4968 , piece_id=PPX2UFHCARMAJFLY5FNRELXRIZ4H6DRCMNEXQK7VNNAFILWYX4NA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.273973004 (15h0m0.503458361s) [noise=true , address=45.91.116.11:4146 , piece_id=BABW62CM3DUAOYVWR5IPSMTFLCTRI6HUWEZZBUGKSSVMBYWSDX2A, seg_pos={0 0}, upload=15529]: Done uploading piece. err: <nil>
Aug 28 08:38:37.274003461 (15h0m0.503488818s) [seg_pos={0 0}, upload=15529]: Segment reached optimal threshold of 14 pieces.
Aug 28 08:38:37.274302303 (15h0m0.50378765s) [noise=true , address=64.49.13.140:4508 , piece_id=PBRSR3GB2IEUIX65VGSN2XH4C4ELPM5N272VYJKU25FEQJ4JFSOQ, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1diUU2skKzXPjYy3Mu3iDDjnG5W8Z2cxCRMxDCH9cQGg2TdEiR): protocol: read tcp 5.161.89.252:10072->64.49.13.140:4508: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274341226 (15h0m0.503826583s) [noise=true , address=64.49.13.154:4936 , piece_id=XI4Q3GJ5NVJPMFZCTFWXGXUK7IJHQMYELCRTRUY3QHSBXDHROE7Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12J4nbkWW5oM17EbRwB53vgPzEiK8dEXM2tR2TWGhJFqEja9RHi): protocol: read tcp 5.161.89.252:15990->64.49.13.154:4936: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274374699 (15h0m0.503860056s) [noise=true , address=79.127.201.215:4348 , piece_id=4ORWR6ICVHXNR26NKMM7ES4I3H4IBHT2YGAICAVN6UXGJQITSESA, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eeQieeLS35wwm6vk8rwcTDPPQgYD9vVhVw8WRt84bduXbaW2j): protocol: read tcp 5.161.89.252:15186->79.127.201.215:4348: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 28 08:38:37.274501718 (15h0m0.503987085s) [noise=true , address=79.127.205.245:4252 , piece_id=TP4AZMRR6O27LLCKAAZ5PNRZJFKTZTZUGRSNAJHYAJ7ULIAS5W3Q, seg_pos={0 0}, upload=15529]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cYp95Dbq7byUc8cN7dF73sUBJEDnyJLDAVozb5jdz3wACLUXQ): protocol: read tcp 5.161.89.252:12078->79.127.205.245:4252: use of closed network connection; context canceled
Aug 28 08:38:37.274529791 (15h0m0.504015168s) [seg_pos={0 0}, upload=15529]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 08:38:37.274605384 (15h0m0.504090751s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 08:38:37.274610052 (15h0m0.50409542s) [upload=15529]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 08:38:37.327657525 (15h0m0.557142902s) [upload=15529]: Done uploading segments...
Aug 28 08:38:37.327676731 (15h0m0.557162108s) [upload=15529]: Upload finished. err: <nil>
Duration: 618.34408ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X........................................X...............] duration:
141.101809ms
FAIL (2025-08-28 09:15:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 09:02:18.699494201 (15h23m41.928979558s) [upload=15948]: Starting upload Aug 28 09:02:18.699566588 (15h23m41.929051945s) [upload=15948]: Done starting upload Aug 28 09:02:18.699621431 (15h23m41.929106788s) [upload=15948]: Uploading segments... Aug 28 09:02:18.699661696 (15h23m41.929147053s) [upload=15948]: Got next segment. Inline: true Aug 28 09:02:18.699667407 (15h23m41.929152814s) [upload=15948]: Waiting for error group managing segments... Aug 28 09:02:18.699730346 (15h23m41.929215693s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 09:02:18.699738331 (15h23m41.929223678s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 09:02:18.699742468 (15h23m41.929227826s) [upload=15948]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 09:02:18.702348129 (15h23m41.931833486s) [upload=15948]: Done uploading segments... Aug 28 09:02:18.702355443 (15h23m41.931840801s) [upload=15948]: Upload finished. err: metaclient: Too Many Requests
Duration: 141.125273ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|