Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
345.603253ms
FAIL (2025-08-11 06:37:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 345.624132ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
154.857734ms
FAIL (2025-08-11 06:36:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.881988ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
404.936392ms
FAIL (2025-08-11 06:36:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 404.960487ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
162.184521ms
FAIL (2025-08-11 06:36:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.206163ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
422.607365ms
FAIL (2025-08-11 06:35:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 422.637972ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
210.74301ms
FAIL (2025-08-11 06:35:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 210.763017ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
365.054369ms
FAIL (2025-08-11 06:34:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 365.076942ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
141.110984ms
FAIL (2025-08-11 06:34:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 141.128777ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
371.369742ms
FAIL (2025-08-11 06:34:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 371.393394ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
316.300777ms
FAIL (2025-08-11 06:33:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 316.323899ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
141.162792ms
FAIL (2025-08-11 06:33:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 141.187658ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
145.580466ms
FAIL (2025-08-11 06:32:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.605443ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
370.203662ms
FAIL (2025-08-11 06:32:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 370.233298ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
542.966304ms
FAIL (2025-08-11 06:31:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 542.986751ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
164.826011ms
FAIL (2025-08-11 06:31:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.849495ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
604.217866ms
FAIL (2025-08-11 06:31:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 604.243684ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
137.548694ms
FAIL (2025-08-11 06:30:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 137.569713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
337.614052ms
FAIL (2025-08-11 06:30:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 337.659075ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
360.406475ms
FAIL (2025-08-11 06:29:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 360.42026ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
124.971291ms
FAIL (2025-08-11 06:29:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 124.991368ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
370.498908ms
FAIL (2025-08-11 06:29:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 370.522843ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
218.34583ms
FAIL (2025-08-11 06:28:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 218.370827ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
349.629528ms
FAIL (2025-08-11 06:28:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 349.642221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
391.430914ms
FAIL (2025-08-11 06:28:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 391.452604ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
401.520812ms
FAIL (2025-08-11 06:28:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 401.547532ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
347.951405ms
FAIL (2025-08-11 06:27:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 347.973507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
518.73723ms
FAIL (2025-08-11 06:27:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 518.755114ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
14.081034ms
FAIL (2025-08-11 06:27:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:27:03.782652248 (61h0m44.513919867s) [upload=63529]: Starting upload Aug 11 06:27:03.782692243 (61h0m44.513959862s) [upload=63529]: Done starting upload Aug 11 06:27:03.782773864 (61h0m44.514041494s) [upload=63529]: Uploading segments... Aug 11 06:27:03.782981913 (61h0m44.514249533s) [upload=63529]: Got next segment. Inline: false Aug 11 06:27:03.783010305 (61h0m44.514277936s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:27:03.783014253 (61h0m44.514281874s) [upload=63529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 06:27:03.785018213 (61h0m44.516285843s) [upload=63529]: Next segment err: metaclient: Too Many Requests Aug 11 06:27:03.785028703 (61h0m44.516296333s) [upload=63529]: Done uploading segments... Aug 11 06:27:03.785036388 (61h0m44.516304008s) [upload=63529]: Upload finished. err: metaclient: Too Many Requests
Duration: 14.091332ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
179.138265ms
FAIL (2025-08-11 06:27:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 179.155928ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
180.637022ms
FAIL (2025-08-11 06:26:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 180.659073ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
253.239032ms
FAIL (2025-08-11 06:25:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 253.262005ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
147.366741ms
FAIL (2025-08-11 06:24:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.39293ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
144.202ms
FAIL (2025-08-11 06:23:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 144.240333ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
298.670129ms
FAIL (2025-08-11 06:22:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 298.68615ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
152.350205ms
FAIL (2025-08-11 06:22:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 152.374709ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
167.013027ms
FAIL (2025-08-11 06:21:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 167.034788ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
236.87739ms
FAIL (2025-08-11 06:21:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 236.896015ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
159.299108ms
FAIL (2025-08-11 06:20:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 159.328903ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
128.121539ms
FAIL (2025-08-11 06:19:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.148789ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
433.040038ms
FAIL (2025-08-11 06:18:32 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:29:38.903820400 (60h3m19.63508803s) [upload=62555]: Starting upload
Aug 11 05:29:38.903871195 (60h3m19.635138825s) [upload=62555]: Done starting upload
Aug 11 05:29:38.903932049 (60h3m19.635199679s) [upload=62555]: Uploading segments...
Aug 11 05:29:38.904133845 (60h3m19.635401465s) [upload=62555]: Got next segment. Inline: false
Aug 11 05:29:38.904164473 (60h3m19.635432103s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:29:38.904169221 (60h3m19.635436851s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:29:38.936017124 (60h3m19.667284754s) [seg_pos={0 0}, upload=62555]: Begin upload segment...
Aug 11 05:29:38.936058813 (60h3m19.667326443s) [seg_pos={0 0}, upload=62555]: Done begin upload segment.
Aug 11 05:29:38.936083749 (60h3m19.667351379s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936128572 (60h3m19.667396192s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936435616 (60h3m19.667703246s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936459892 (60h3m19.667727522s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936674212 (60h3m19.667941842s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936787343 (60h3m19.668054963s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936953723 (60h3m19.668221353s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937142276 (60h3m19.668409895s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937217736 (60h3m19.668485366s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937527293 (60h3m19.668794923s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937578089 (60h3m19.668845708s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937843034 (60h3m19.669110664s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937958560 (60h3m19.669226209s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938084283 (60h3m19.669351913s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938298564 (60h3m19.669566194s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938307631 (60h3m19.669575261s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938599516 (60h3m19.669867135s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938637397 (60h3m19.669905017s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:39.019590929 (60h3m19.750858549s) [upload=62555]: Next returned nil segment
Aug 11 05:29:39.019601609 (60h3m19.750869229s) [upload=62555]: Waiting for error group managing segments...
Aug 11 05:29:39.029994460 (60h3m19.76126208s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.034133997 (60h3m19.765401617s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035249570 (60h3m19.76651719s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035300304 (60h3m19.766567924s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035732130 (60h3m19.766999751s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037186637 (60h3m19.768454256s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037882095 (60h3m19.769149714s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.044448963 (60h3m19.775716583s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.050688541 (60h3m19.781956162s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.051071335 (60h3m19.782338955s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.053696445 (60h3m19.784964066s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.054878833 (60h3m19.786146464s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.059713950 (60h3m19.79098158s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064878029 (60h3m19.796145649s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064910360 (60h3m19.79617799s) [seg_pos={0 0}, upload=62555]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:29:39.065032779 (60h3m19.796300398s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF
Aug 11 05:29:39.065242760 (60h3m19.79651039s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: read tcp 5.161.89.252:40054->64.49.13.138:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065334922 (60h3m19.796602552s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 5.161.89.252:24344->64.49.13.139:4474: use of closed network connection; conn closed: op
Aug 11 05:29:39.065368074 (60h3m19.796635704s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: read tcp 5.161.89.252:39868->64.49.13.170:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065450418 (60h3m19.796718038s) [seg_pos={0 0}, upload=62555]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:29:39.065501734 (60h3m19.796769364s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:29:39.065505391 (60h3m19.796773011s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:29:39.119294152 (60h3m19.850561802s) [upload=62555]: Done uploading segments...
Aug 11 05:29:39.119307627 (60h3m19.850575277s) [upload=62555]: Upload finished. err: <nil>
Duration: 433.061858ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
142.76378ms
FAIL (2025-08-11 06:18:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 142.790791ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
391.37842ms
FAIL (2025-08-11 06:17:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:29:38.903820400 (60h3m19.63508803s) [upload=62555]: Starting upload
Aug 11 05:29:38.903871195 (60h3m19.635138825s) [upload=62555]: Done starting upload
Aug 11 05:29:38.903932049 (60h3m19.635199679s) [upload=62555]: Uploading segments...
Aug 11 05:29:38.904133845 (60h3m19.635401465s) [upload=62555]: Got next segment. Inline: false
Aug 11 05:29:38.904164473 (60h3m19.635432103s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:29:38.904169221 (60h3m19.635436851s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:29:38.936017124 (60h3m19.667284754s) [seg_pos={0 0}, upload=62555]: Begin upload segment...
Aug 11 05:29:38.936058813 (60h3m19.667326443s) [seg_pos={0 0}, upload=62555]: Done begin upload segment.
Aug 11 05:29:38.936083749 (60h3m19.667351379s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936128572 (60h3m19.667396192s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936435616 (60h3m19.667703246s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936459892 (60h3m19.667727522s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936674212 (60h3m19.667941842s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936787343 (60h3m19.668054963s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936953723 (60h3m19.668221353s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937142276 (60h3m19.668409895s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937217736 (60h3m19.668485366s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937527293 (60h3m19.668794923s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937578089 (60h3m19.668845708s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937843034 (60h3m19.669110664s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937958560 (60h3m19.669226209s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938084283 (60h3m19.669351913s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938298564 (60h3m19.669566194s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938307631 (60h3m19.669575261s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938599516 (60h3m19.669867135s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938637397 (60h3m19.669905017s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:39.019590929 (60h3m19.750858549s) [upload=62555]: Next returned nil segment
Aug 11 05:29:39.019601609 (60h3m19.750869229s) [upload=62555]: Waiting for error group managing segments...
Aug 11 05:29:39.029994460 (60h3m19.76126208s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.034133997 (60h3m19.765401617s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035249570 (60h3m19.76651719s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035300304 (60h3m19.766567924s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035732130 (60h3m19.766999751s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037186637 (60h3m19.768454256s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037882095 (60h3m19.769149714s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.044448963 (60h3m19.775716583s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.050688541 (60h3m19.781956162s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.051071335 (60h3m19.782338955s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.053696445 (60h3m19.784964066s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.054878833 (60h3m19.786146464s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.059713950 (60h3m19.79098158s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064878029 (60h3m19.796145649s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064910360 (60h3m19.79617799s) [seg_pos={0 0}, upload=62555]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:29:39.065032779 (60h3m19.796300398s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF
Aug 11 05:29:39.065242760 (60h3m19.79651039s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: read tcp 5.161.89.252:40054->64.49.13.138:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065334922 (60h3m19.796602552s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 5.161.89.252:24344->64.49.13.139:4474: use of closed network connection; conn closed: op
Aug 11 05:29:39.065368074 (60h3m19.796635704s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: read tcp 5.161.89.252:39868->64.49.13.170:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065450418 (60h3m19.796718038s) [seg_pos={0 0}, upload=62555]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:29:39.065501734 (60h3m19.796769364s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:29:39.065505391 (60h3m19.796773011s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:29:39.119294152 (60h3m19.850561802s) [upload=62555]: Done uploading segments...
Aug 11 05:29:39.119307627 (60h3m19.850575277s) [upload=62555]: Upload finished. err: <nil>
Duration: 391.403567ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
16.952954ms
FAIL (2025-08-11 06:17:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 06:17:26.788058523 (60h51m7.519326153s) [upload=63360]: Starting upload Aug 11 06:17:26.788091424 (60h51m7.519359044s) [upload=63360]: Done starting upload Aug 11 06:17:26.788137530 (60h51m7.51940516s) [upload=63360]: Uploading segments... Aug 11 06:17:26.788166414 (60h51m7.519434044s) [upload=63360]: Got next segment. Inline: true Aug 11 06:17:26.788170191 (60h51m7.519437821s) [upload=63360]: Waiting for error group managing segments... Aug 11 06:17:26.788200848 (60h51m7.519468468s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 06:17:26.788204235 (60h51m7.519471865s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 06:17:26.788206459 (60h51m7.519474079s) [upload=63360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 06:17:26.791117332 (60h51m7.522384992s) [upload=63360]: Done uploading segments... Aug 11 06:17:26.791137981 (60h51m7.522405631s) [upload=63360]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.978732ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
439.046051ms
FAIL (2025-08-11 06:16:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:29:38.903820400 (60h3m19.63508803s) [upload=62555]: Starting upload
Aug 11 05:29:38.903871195 (60h3m19.635138825s) [upload=62555]: Done starting upload
Aug 11 05:29:38.903932049 (60h3m19.635199679s) [upload=62555]: Uploading segments...
Aug 11 05:29:38.904133845 (60h3m19.635401465s) [upload=62555]: Got next segment. Inline: false
Aug 11 05:29:38.904164473 (60h3m19.635432103s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:29:38.904169221 (60h3m19.635436851s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:29:38.936017124 (60h3m19.667284754s) [seg_pos={0 0}, upload=62555]: Begin upload segment...
Aug 11 05:29:38.936058813 (60h3m19.667326443s) [seg_pos={0 0}, upload=62555]: Done begin upload segment.
Aug 11 05:29:38.936083749 (60h3m19.667351379s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936128572 (60h3m19.667396192s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936435616 (60h3m19.667703246s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936459892 (60h3m19.667727522s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936674212 (60h3m19.667941842s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936787343 (60h3m19.668054963s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936953723 (60h3m19.668221353s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937142276 (60h3m19.668409895s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937217736 (60h3m19.668485366s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937527293 (60h3m19.668794923s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937578089 (60h3m19.668845708s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937843034 (60h3m19.669110664s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937958560 (60h3m19.669226209s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938084283 (60h3m19.669351913s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938298564 (60h3m19.669566194s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938307631 (60h3m19.669575261s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938599516 (60h3m19.669867135s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938637397 (60h3m19.669905017s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:39.019590929 (60h3m19.750858549s) [upload=62555]: Next returned nil segment
Aug 11 05:29:39.019601609 (60h3m19.750869229s) [upload=62555]: Waiting for error group managing segments...
Aug 11 05:29:39.029994460 (60h3m19.76126208s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.034133997 (60h3m19.765401617s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035249570 (60h3m19.76651719s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035300304 (60h3m19.766567924s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035732130 (60h3m19.766999751s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037186637 (60h3m19.768454256s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037882095 (60h3m19.769149714s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.044448963 (60h3m19.775716583s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.050688541 (60h3m19.781956162s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.051071335 (60h3m19.782338955s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.053696445 (60h3m19.784964066s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.054878833 (60h3m19.786146464s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.059713950 (60h3m19.79098158s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064878029 (60h3m19.796145649s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064910360 (60h3m19.79617799s) [seg_pos={0 0}, upload=62555]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:29:39.065032779 (60h3m19.796300398s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF
Aug 11 05:29:39.065242760 (60h3m19.79651039s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: read tcp 5.161.89.252:40054->64.49.13.138:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065334922 (60h3m19.796602552s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 5.161.89.252:24344->64.49.13.139:4474: use of closed network connection; conn closed: op
Aug 11 05:29:39.065368074 (60h3m19.796635704s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: read tcp 5.161.89.252:39868->64.49.13.170:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065450418 (60h3m19.796718038s) [seg_pos={0 0}, upload=62555]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:29:39.065501734 (60h3m19.796769364s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:29:39.065505391 (60h3m19.796773011s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:29:39.119294152 (60h3m19.850561802s) [upload=62555]: Done uploading segments...
Aug 11 05:29:39.119307627 (60h3m19.850575277s) [upload=62555]: Upload finished. err: <nil>
Duration: 439.071849ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
373.002147ms
FAIL (2025-08-11 06:16:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:29:38.903820400 (60h3m19.63508803s) [upload=62555]: Starting upload
Aug 11 05:29:38.903871195 (60h3m19.635138825s) [upload=62555]: Done starting upload
Aug 11 05:29:38.903932049 (60h3m19.635199679s) [upload=62555]: Uploading segments...
Aug 11 05:29:38.904133845 (60h3m19.635401465s) [upload=62555]: Got next segment. Inline: false
Aug 11 05:29:38.904164473 (60h3m19.635432103s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:29:38.904169221 (60h3m19.635436851s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:29:38.936017124 (60h3m19.667284754s) [seg_pos={0 0}, upload=62555]: Begin upload segment...
Aug 11 05:29:38.936058813 (60h3m19.667326443s) [seg_pos={0 0}, upload=62555]: Done begin upload segment.
Aug 11 05:29:38.936083749 (60h3m19.667351379s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936128572 (60h3m19.667396192s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936435616 (60h3m19.667703246s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936459892 (60h3m19.667727522s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936674212 (60h3m19.667941842s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936787343 (60h3m19.668054963s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936953723 (60h3m19.668221353s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937142276 (60h3m19.668409895s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937217736 (60h3m19.668485366s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937527293 (60h3m19.668794923s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937578089 (60h3m19.668845708s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937843034 (60h3m19.669110664s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937958560 (60h3m19.669226209s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938084283 (60h3m19.669351913s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938298564 (60h3m19.669566194s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938307631 (60h3m19.669575261s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938599516 (60h3m19.669867135s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938637397 (60h3m19.669905017s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:39.019590929 (60h3m19.750858549s) [upload=62555]: Next returned nil segment
Aug 11 05:29:39.019601609 (60h3m19.750869229s) [upload=62555]: Waiting for error group managing segments...
Aug 11 05:29:39.029994460 (60h3m19.76126208s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.034133997 (60h3m19.765401617s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035249570 (60h3m19.76651719s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035300304 (60h3m19.766567924s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035732130 (60h3m19.766999751s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037186637 (60h3m19.768454256s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037882095 (60h3m19.769149714s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.044448963 (60h3m19.775716583s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.050688541 (60h3m19.781956162s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.051071335 (60h3m19.782338955s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.053696445 (60h3m19.784964066s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.054878833 (60h3m19.786146464s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.059713950 (60h3m19.79098158s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064878029 (60h3m19.796145649s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064910360 (60h3m19.79617799s) [seg_pos={0 0}, upload=62555]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:29:39.065032779 (60h3m19.796300398s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF
Aug 11 05:29:39.065242760 (60h3m19.79651039s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: read tcp 5.161.89.252:40054->64.49.13.138:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065334922 (60h3m19.796602552s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 5.161.89.252:24344->64.49.13.139:4474: use of closed network connection; conn closed: op
Aug 11 05:29:39.065368074 (60h3m19.796635704s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: read tcp 5.161.89.252:39868->64.49.13.170:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065450418 (60h3m19.796718038s) [seg_pos={0 0}, upload=62555]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:29:39.065501734 (60h3m19.796769364s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:29:39.065505391 (60h3m19.796773011s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:29:39.119294152 (60h3m19.850561802s) [upload=62555]: Done uploading segments...
Aug 11 05:29:39.119307627 (60h3m19.850575277s) [upload=62555]: Upload finished. err: <nil>
Duration: 373.022343ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
460.429825ms
FAIL (2025-08-11 06:15:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:29:38.903820400 (60h3m19.63508803s) [upload=62555]: Starting upload
Aug 11 05:29:38.903871195 (60h3m19.635138825s) [upload=62555]: Done starting upload
Aug 11 05:29:38.903932049 (60h3m19.635199679s) [upload=62555]: Uploading segments...
Aug 11 05:29:38.904133845 (60h3m19.635401465s) [upload=62555]: Got next segment. Inline: false
Aug 11 05:29:38.904164473 (60h3m19.635432103s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:29:38.904169221 (60h3m19.635436851s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:29:38.936017124 (60h3m19.667284754s) [seg_pos={0 0}, upload=62555]: Begin upload segment...
Aug 11 05:29:38.936058813 (60h3m19.667326443s) [seg_pos={0 0}, upload=62555]: Done begin upload segment.
Aug 11 05:29:38.936083749 (60h3m19.667351379s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936128572 (60h3m19.667396192s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936435616 (60h3m19.667703246s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936459892 (60h3m19.667727522s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936674212 (60h3m19.667941842s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936787343 (60h3m19.668054963s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936953723 (60h3m19.668221353s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937142276 (60h3m19.668409895s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937217736 (60h3m19.668485366s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937527293 (60h3m19.668794923s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937578089 (60h3m19.668845708s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937843034 (60h3m19.669110664s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937958560 (60h3m19.669226209s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938084283 (60h3m19.669351913s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938298564 (60h3m19.669566194s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938307631 (60h3m19.669575261s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938599516 (60h3m19.669867135s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938637397 (60h3m19.669905017s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:39.019590929 (60h3m19.750858549s) [upload=62555]: Next returned nil segment
Aug 11 05:29:39.019601609 (60h3m19.750869229s) [upload=62555]: Waiting for error group managing segments...
Aug 11 05:29:39.029994460 (60h3m19.76126208s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.034133997 (60h3m19.765401617s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035249570 (60h3m19.76651719s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035300304 (60h3m19.766567924s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035732130 (60h3m19.766999751s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037186637 (60h3m19.768454256s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037882095 (60h3m19.769149714s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.044448963 (60h3m19.775716583s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.050688541 (60h3m19.781956162s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.051071335 (60h3m19.782338955s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.053696445 (60h3m19.784964066s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.054878833 (60h3m19.786146464s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.059713950 (60h3m19.79098158s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064878029 (60h3m19.796145649s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064910360 (60h3m19.79617799s) [seg_pos={0 0}, upload=62555]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:29:39.065032779 (60h3m19.796300398s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF
Aug 11 05:29:39.065242760 (60h3m19.79651039s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: read tcp 5.161.89.252:40054->64.49.13.138:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065334922 (60h3m19.796602552s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 5.161.89.252:24344->64.49.13.139:4474: use of closed network connection; conn closed: op
Aug 11 05:29:39.065368074 (60h3m19.796635704s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: read tcp 5.161.89.252:39868->64.49.13.170:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065450418 (60h3m19.796718038s) [seg_pos={0 0}, upload=62555]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:29:39.065501734 (60h3m19.796769364s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:29:39.065505391 (60h3m19.796773011s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:29:39.119294152 (60h3m19.850561802s) [upload=62555]: Done uploading segments...
Aug 11 05:29:39.119307627 (60h3m19.850575277s) [upload=62555]: Upload finished. err: <nil>
Duration: 460.51808ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
396.924592ms
FAIL (2025-08-11 06:14:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:29:38.903820400 (60h3m19.63508803s) [upload=62555]: Starting upload
Aug 11 05:29:38.903871195 (60h3m19.635138825s) [upload=62555]: Done starting upload
Aug 11 05:29:38.903932049 (60h3m19.635199679s) [upload=62555]: Uploading segments...
Aug 11 05:29:38.904133845 (60h3m19.635401465s) [upload=62555]: Got next segment. Inline: false
Aug 11 05:29:38.904164473 (60h3m19.635432103s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:29:38.904169221 (60h3m19.635436851s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:29:38.936017124 (60h3m19.667284754s) [seg_pos={0 0}, upload=62555]: Begin upload segment...
Aug 11 05:29:38.936058813 (60h3m19.667326443s) [seg_pos={0 0}, upload=62555]: Done begin upload segment.
Aug 11 05:29:38.936083749 (60h3m19.667351379s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936128572 (60h3m19.667396192s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936435616 (60h3m19.667703246s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936459892 (60h3m19.667727522s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936674212 (60h3m19.667941842s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936787343 (60h3m19.668054963s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936953723 (60h3m19.668221353s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937142276 (60h3m19.668409895s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937217736 (60h3m19.668485366s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937527293 (60h3m19.668794923s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937578089 (60h3m19.668845708s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937843034 (60h3m19.669110664s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937958560 (60h3m19.669226209s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938084283 (60h3m19.669351913s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938298564 (60h3m19.669566194s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938307631 (60h3m19.669575261s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938599516 (60h3m19.669867135s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938637397 (60h3m19.669905017s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:39.019590929 (60h3m19.750858549s) [upload=62555]: Next returned nil segment
Aug 11 05:29:39.019601609 (60h3m19.750869229s) [upload=62555]: Waiting for error group managing segments...
Aug 11 05:29:39.029994460 (60h3m19.76126208s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.034133997 (60h3m19.765401617s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035249570 (60h3m19.76651719s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035300304 (60h3m19.766567924s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035732130 (60h3m19.766999751s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037186637 (60h3m19.768454256s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037882095 (60h3m19.769149714s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.044448963 (60h3m19.775716583s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.050688541 (60h3m19.781956162s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.051071335 (60h3m19.782338955s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.053696445 (60h3m19.784964066s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.054878833 (60h3m19.786146464s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.059713950 (60h3m19.79098158s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064878029 (60h3m19.796145649s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064910360 (60h3m19.79617799s) [seg_pos={0 0}, upload=62555]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:29:39.065032779 (60h3m19.796300398s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF
Aug 11 05:29:39.065242760 (60h3m19.79651039s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: read tcp 5.161.89.252:40054->64.49.13.138:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065334922 (60h3m19.796602552s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 5.161.89.252:24344->64.49.13.139:4474: use of closed network connection; conn closed: op
Aug 11 05:29:39.065368074 (60h3m19.796635704s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: read tcp 5.161.89.252:39868->64.49.13.170:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065450418 (60h3m19.796718038s) [seg_pos={0 0}, upload=62555]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:29:39.065501734 (60h3m19.796769364s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:29:39.065505391 (60h3m19.796773011s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:29:39.119294152 (60h3m19.850561802s) [upload=62555]: Done uploading segments...
Aug 11 05:29:39.119307627 (60h3m19.850575277s) [upload=62555]: Upload finished. err: <nil>
Duration: 396.940181ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
434.188893ms
FAIL (2025-08-11 06:14:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:29:38.903820400 (60h3m19.63508803s) [upload=62555]: Starting upload
Aug 11 05:29:38.903871195 (60h3m19.635138825s) [upload=62555]: Done starting upload
Aug 11 05:29:38.903932049 (60h3m19.635199679s) [upload=62555]: Uploading segments...
Aug 11 05:29:38.904133845 (60h3m19.635401465s) [upload=62555]: Got next segment. Inline: false
Aug 11 05:29:38.904164473 (60h3m19.635432103s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:29:38.904169221 (60h3m19.635436851s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:29:38.936017124 (60h3m19.667284754s) [seg_pos={0 0}, upload=62555]: Begin upload segment...
Aug 11 05:29:38.936058813 (60h3m19.667326443s) [seg_pos={0 0}, upload=62555]: Done begin upload segment.
Aug 11 05:29:38.936083749 (60h3m19.667351379s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936128572 (60h3m19.667396192s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936435616 (60h3m19.667703246s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936459892 (60h3m19.667727522s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936674212 (60h3m19.667941842s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936787343 (60h3m19.668054963s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936953723 (60h3m19.668221353s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937142276 (60h3m19.668409895s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937217736 (60h3m19.668485366s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937527293 (60h3m19.668794923s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937578089 (60h3m19.668845708s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937843034 (60h3m19.669110664s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937958560 (60h3m19.669226209s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938084283 (60h3m19.669351913s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938298564 (60h3m19.669566194s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938307631 (60h3m19.669575261s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938599516 (60h3m19.669867135s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938637397 (60h3m19.669905017s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:39.019590929 (60h3m19.750858549s) [upload=62555]: Next returned nil segment
Aug 11 05:29:39.019601609 (60h3m19.750869229s) [upload=62555]: Waiting for error group managing segments...
Aug 11 05:29:39.029994460 (60h3m19.76126208s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.034133997 (60h3m19.765401617s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035249570 (60h3m19.76651719s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035300304 (60h3m19.766567924s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035732130 (60h3m19.766999751s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037186637 (60h3m19.768454256s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037882095 (60h3m19.769149714s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.044448963 (60h3m19.775716583s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.050688541 (60h3m19.781956162s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.051071335 (60h3m19.782338955s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.053696445 (60h3m19.784964066s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.054878833 (60h3m19.786146464s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.059713950 (60h3m19.79098158s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064878029 (60h3m19.796145649s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064910360 (60h3m19.79617799s) [seg_pos={0 0}, upload=62555]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:29:39.065032779 (60h3m19.796300398s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF
Aug 11 05:29:39.065242760 (60h3m19.79651039s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: read tcp 5.161.89.252:40054->64.49.13.138:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065334922 (60h3m19.796602552s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 5.161.89.252:24344->64.49.13.139:4474: use of closed network connection; conn closed: op
Aug 11 05:29:39.065368074 (60h3m19.796635704s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: read tcp 5.161.89.252:39868->64.49.13.170:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065450418 (60h3m19.796718038s) [seg_pos={0 0}, upload=62555]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:29:39.065501734 (60h3m19.796769364s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:29:39.065505391 (60h3m19.796773011s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:29:39.119294152 (60h3m19.850561802s) [upload=62555]: Done uploading segments...
Aug 11 05:29:39.119307627 (60h3m19.850575277s) [upload=62555]: Upload finished. err: <nil>
Duration: 434.496406ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
422.935988ms
FAIL (2025-08-11 06:13:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:29:38.903820400 (60h3m19.63508803s) [upload=62555]: Starting upload
Aug 11 05:29:38.903871195 (60h3m19.635138825s) [upload=62555]: Done starting upload
Aug 11 05:29:38.903932049 (60h3m19.635199679s) [upload=62555]: Uploading segments...
Aug 11 05:29:38.904133845 (60h3m19.635401465s) [upload=62555]: Got next segment. Inline: false
Aug 11 05:29:38.904164473 (60h3m19.635432103s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:29:38.904169221 (60h3m19.635436851s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:29:38.936017124 (60h3m19.667284754s) [seg_pos={0 0}, upload=62555]: Begin upload segment...
Aug 11 05:29:38.936058813 (60h3m19.667326443s) [seg_pos={0 0}, upload=62555]: Done begin upload segment.
Aug 11 05:29:38.936083749 (60h3m19.667351379s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936128572 (60h3m19.667396192s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936435616 (60h3m19.667703246s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936459892 (60h3m19.667727522s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936674212 (60h3m19.667941842s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936787343 (60h3m19.668054963s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936953723 (60h3m19.668221353s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937142276 (60h3m19.668409895s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937217736 (60h3m19.668485366s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937527293 (60h3m19.668794923s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937578089 (60h3m19.668845708s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937843034 (60h3m19.669110664s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937958560 (60h3m19.669226209s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938084283 (60h3m19.669351913s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938298564 (60h3m19.669566194s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938307631 (60h3m19.669575261s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938599516 (60h3m19.669867135s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938637397 (60h3m19.669905017s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:39.019590929 (60h3m19.750858549s) [upload=62555]: Next returned nil segment
Aug 11 05:29:39.019601609 (60h3m19.750869229s) [upload=62555]: Waiting for error group managing segments...
Aug 11 05:29:39.029994460 (60h3m19.76126208s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.034133997 (60h3m19.765401617s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035249570 (60h3m19.76651719s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035300304 (60h3m19.766567924s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035732130 (60h3m19.766999751s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037186637 (60h3m19.768454256s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037882095 (60h3m19.769149714s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.044448963 (60h3m19.775716583s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.050688541 (60h3m19.781956162s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.051071335 (60h3m19.782338955s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.053696445 (60h3m19.784964066s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.054878833 (60h3m19.786146464s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.059713950 (60h3m19.79098158s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064878029 (60h3m19.796145649s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064910360 (60h3m19.79617799s) [seg_pos={0 0}, upload=62555]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:29:39.065032779 (60h3m19.796300398s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF
Aug 11 05:29:39.065242760 (60h3m19.79651039s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: read tcp 5.161.89.252:40054->64.49.13.138:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065334922 (60h3m19.796602552s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 5.161.89.252:24344->64.49.13.139:4474: use of closed network connection; conn closed: op
Aug 11 05:29:39.065368074 (60h3m19.796635704s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: read tcp 5.161.89.252:39868->64.49.13.170:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065450418 (60h3m19.796718038s) [seg_pos={0 0}, upload=62555]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:29:39.065501734 (60h3m19.796769364s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:29:39.065505391 (60h3m19.796773011s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:29:39.119294152 (60h3m19.850561802s) [upload=62555]: Done uploading segments...
Aug 11 05:29:39.119307627 (60h3m19.850575277s) [upload=62555]: Upload finished. err: <nil>
Duration: 422.953963ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
672.603339ms
FAIL (2025-08-11 06:12:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 11 05:29:38.903820400 (60h3m19.63508803s) [upload=62555]: Starting upload
Aug 11 05:29:38.903871195 (60h3m19.635138825s) [upload=62555]: Done starting upload
Aug 11 05:29:38.903932049 (60h3m19.635199679s) [upload=62555]: Uploading segments...
Aug 11 05:29:38.904133845 (60h3m19.635401465s) [upload=62555]: Got next segment. Inline: false
Aug 11 05:29:38.904164473 (60h3m19.635432103s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 05:29:38.904169221 (60h3m19.635436851s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 05:29:38.936017124 (60h3m19.667284754s) [seg_pos={0 0}, upload=62555]: Begin upload segment...
Aug 11 05:29:38.936058813 (60h3m19.667326443s) [seg_pos={0 0}, upload=62555]: Done begin upload segment.
Aug 11 05:29:38.936083749 (60h3m19.667351379s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936128572 (60h3m19.667396192s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936435616 (60h3m19.667703246s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936459892 (60h3m19.667727522s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936674212 (60h3m19.667941842s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936787343 (60h3m19.668054963s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.936953723 (60h3m19.668221353s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937142276 (60h3m19.668409895s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937217736 (60h3m19.668485366s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937527293 (60h3m19.668794923s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937578089 (60h3m19.668845708s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937843034 (60h3m19.669110664s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.937958560 (60h3m19.669226209s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938084283 (60h3m19.669351913s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938298564 (60h3m19.669566194s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938307631 (60h3m19.669575261s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938599516 (60h3m19.669867135s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:38.938637397 (60h3m19.669905017s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Uploading piece...
Aug 11 05:29:39.019590929 (60h3m19.750858549s) [upload=62555]: Next returned nil segment
Aug 11 05:29:39.019601609 (60h3m19.750869229s) [upload=62555]: Waiting for error group managing segments...
Aug 11 05:29:39.029994460 (60h3m19.76126208s) [noise=true , address=45.91.116.7:4025 , piece_id=UBUM66BR42W3SGZIFLY5RTFPSGBAV7F3E5Y5HBD5TYDWIM6KP6DA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.034133997 (60h3m19.765401617s) [noise=true , address=104.36.82.60:4370 , piece_id=GQS6EJFWRVSOKB5HRNNMP4NW47M6WQ7E346GFQ2GIFU6ECZYN7IA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035249570 (60h3m19.76651719s) [noise=true , address=104.36.82.8:4984 , piece_id=EKT5UE4BXCBIJC57LBU4PWIVNXWTDDS436BPH4Z7DJCNIJGJ6RHQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035300304 (60h3m19.766567924s) [noise=true , address=104.36.82.39:4744 , piece_id=ROOPUKVIQPWJGGBE6HS46K3KE7C6EUNLQM5SVDZ52UGBVWODHM7A, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.035732130 (60h3m19.766999751s) [noise=true , address=104.36.82.61:4384 , piece_id=HAN5YEQTTIK6DKKZQC5IZWKYNMT7D6GHGNN7JM6IXSY2XTYN6SUA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037186637 (60h3m19.768454256s) [noise=true , address=104.36.82.58:4298 , piece_id=YCW24SKO3UGTGM4EXKMSYVZHFZADKTUI74LMVGCELUAWFO556RMA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.037882095 (60h3m19.769149714s) [noise=true , address=104.36.82.37:4687 , piece_id=QKHJ6EJTHKPYKPKZNHUNK7GOA2PNFMYH24PEFIOCWZLCYNDOIWXQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.044448963 (60h3m19.775716583s) [noise=true , address=104.36.82.8:4988 , piece_id=WGPDYIW44S2QOCH5W7V2A5CNWFG2YIOLGFDBLFLJHNNXTGFO75NA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.050688541 (60h3m19.781956162s) [noise=true , address=104.36.82.43:4855 , piece_id=4XZAUXNWYDP4QGKSUKDWXSFYC3DPYE3WBKJFZYUQEOOLZSEW65WA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.051071335 (60h3m19.782338955s) [noise=true , address=104.36.82.9:4028 , piece_id=N3WFCXTESXDK2D5YM42D77622JURB3CGTM23SHCX3PIAZMSFF5SA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.053696445 (60h3m19.784964066s) [noise=true , address=104.36.82.23:4452 , piece_id=BHARBT6Y4EJNNAMFELFAWGPK4BVEANQ4YSVY3X2QS2JVU43EU4CA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.054878833 (60h3m19.786146464s) [noise=true , address=104.36.82.46:4513 , piece_id=DHHYS7CNPXXI2MXNQQLR7J7RNKHDMONHTDGLHGJ4NIVPK5R7ZGIQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.059713950 (60h3m19.79098158s) [noise=true , address=104.36.82.45:4939 , piece_id=TVILKBJTPBQYZUBNZ7DZRS5GE6G3YFGX3B6EGPP3VEQQWI54PDKA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064878029 (60h3m19.796145649s) [noise=true , address=104.36.82.5:4867 , piece_id=NT7OMPW4S2G3AC7P6KM27MPZ3GTZGUAC545XLJRKTQBRTX27IAFA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: <nil>
Aug 11 05:29:39.064910360 (60h3m19.79617799s) [seg_pos={0 0}, upload=62555]: Segment reached optimal threshold of 14 pieces.
Aug 11 05:29:39.065032779 (60h3m19.796300398s) [noise=true , address=104.36.82.16:4308 , piece_id=SHOTI7IAYV2QIPJW5SOGPFJSJ2N3Y7KG6GMJ4ZS3XMSKFJEADUOA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF
Aug 11 05:29:39.065242760 (60h3m19.79651039s) [noise=true , address=64.49.13.138:4490 , piece_id=NYXJWCAR3MQF4BTAZG7S5ZDXTJKKMJWAETZKPSZDUZBHO4IOP6IQ, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jp1vcm8dpppQHEfAtYmM29CDS3mqhojhuVrzkL3PsYHW2q8zA): protocol: read tcp 5.161.89.252:40054->64.49.13.138:4490: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065334922 (60h3m19.796602552s) [noise=true , address=64.49.13.139:4474 , piece_id=HFXEBNZXK367X4GQZ73GIFK5WIMDVQS5G2HJM62QWEFR2NWPBSQA, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 5.161.89.252:24344->64.49.13.139:4474: use of closed network connection; conn closed: op
Aug 11 05:29:39.065368074 (60h3m19.796635704s) [noise=true , address=64.49.13.170:4725 , piece_id=HGPDIOMTNSTS3UKOQELU5QCHJPW2PTUDR5BHUVZCXQP7G2Y3SQ5Q, seg_pos={0 0}, upload=62555]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mit6F4Yz1qKuVeXhhfBpNd5MsfxWLz8dCUAHsBeGzCdLJn8Ne): protocol: read tcp 5.161.89.252:39868->64.49.13.170:4725: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 11 05:29:39.065450418 (60h3m19.796718038s) [seg_pos={0 0}, upload=62555]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 05:29:39.065501734 (60h3m19.796769364s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 05:29:39.065505391 (60h3m19.796773011s) [upload=62555]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 05:29:39.119294152 (60h3m19.850561802s) [upload=62555]: Done uploading segments...
Aug 11 05:29:39.119307627 (60h3m19.850575277s) [upload=62555]: Upload finished. err: <nil>
Duration: 672.624159ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|