Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X............................X..............X] duration:
30.728495ms
FAIL (2025-08-19 07:35:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:35:59.574378517 (254h9m40.305646147s) [upload=264360]: Starting upload Aug 19 07:35:59.574420676 (254h9m40.305688296s) [upload=264360]: Done starting upload Aug 19 07:35:59.574472293 (254h9m40.305739923s) [upload=264360]: Uploading segments... Aug 19 07:35:59.574523991 (254h9m40.305791621s) [upload=264360]: Got next segment. Inline: true Aug 19 07:35:59.574528068 (254h9m40.305795688s) [upload=264360]: Waiting for error group managing segments... Aug 19 07:35:59.574567262 (254h9m40.305834892s) [upload=264360]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:35:59.574573153 (254h9m40.305840783s) [upload=264360]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:35:59.574577391 (254h9m40.305845011s) [upload=264360]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:35:59.582332891 (254h9m40.313600521s) [upload=264360]: Done uploading segments... Aug 19 07:35:59.582340485 (254h9m40.313608115s) [upload=264360]: Upload finished. err: metaclient: Too Many Requests
Duration: 30.738694ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X............................X..............] duration:
217.60443ms
FAIL (2025-08-19 07:34:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 217.62537ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X............................X.............] duration:
112.875577ms
FAIL (2025-08-19 07:34:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 112.912226ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X............................X............] duration:
381.625964ms
FAIL (2025-08-19 07:33:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 381.646423ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X............................X...........] duration:
148.229839ms
FAIL (2025-08-19 07:32:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.280534ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X............................X..........] duration:
109.595443ms
FAIL (2025-08-19 07:32:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 109.622424ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X............................X.........] duration:
246.869409ms
FAIL (2025-08-19 07:31:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 246.898814ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X............................X........] duration:
115.324999ms
FAIL (2025-08-19 07:31:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 115.344315ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X............................X.......] duration:
123.979489ms
FAIL (2025-08-19 07:31:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 124.00684ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X............................X......] duration:
123.233967ms
FAIL (2025-08-19 07:30:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.251329ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X............................X.....] duration:
134.674422ms
FAIL (2025-08-19 07:29:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.698247ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X............................X....] duration:
168.765878ms
FAIL (2025-08-19 07:29:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.784712ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
625.872295ms
FAIL (2025-08-19 07:28:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 625.894137ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X............................X...] duration:
377.289222ms
FAIL (2025-08-19 07:28:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 377.318768ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.014503666s
FAIL (2025-08-19 07:27:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 1.014519795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X............................X..] duration:
136.92075ms
FAIL (2025-08-19 07:27:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 136.949525ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
658.079202ms
FAIL (2025-08-19 07:26:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 658.103658ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X............................X.] duration:
126.202385ms
FAIL (2025-08-19 07:26:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 126.236699ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
857.208524ms
FAIL (2025-08-19 07:26:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 857.230887ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X............................X] duration:
19.525996ms
FAIL (2025-08-19 07:25:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:25:44.132515902 (253h59m24.863783551s) [upload=264174]: Starting upload Aug 19 07:25:44.132588648 (253h59m24.863856288s) [upload=264174]: Done starting upload Aug 19 07:25:44.132742788 (253h59m24.864010438s) [upload=264174]: Uploading segments... Aug 19 07:25:44.132815576 (253h59m24.864083225s) [upload=264174]: Got next segment. Inline: true Aug 19 07:25:44.132821427 (253h59m24.864089067s) [upload=264174]: Waiting for error group managing segments... Aug 19 07:25:44.132907468 (253h59m24.864175118s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:25:44.132926143 (253h59m24.864193793s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:25:44.132929739 (253h59m24.86419739s) [upload=264174]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:25:44.135192149 (253h59m24.866459769s) [upload=264174]: Done uploading segments... Aug 19 07:25:44.135205033 (253h59m24.866472653s) [upload=264174]: Upload finished. err: metaclient: Too Many Requests
Duration: 19.541154ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
311.44085ms
FAIL (2025-08-19 07:25:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 311.464314ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.884118683s
FAIL (2025-08-19 07:25:20 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 1.884142378s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
134.461911ms
FAIL (2025-08-19 07:24:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.485274ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
783.182266ms
FAIL (2025-08-19 07:24:44 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 783.212324ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
128.289753ms
FAIL (2025-08-19 07:24:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.308108ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
946.887926ms
FAIL (2025-08-19 07:23:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 946.914987ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
3.244693979s
FAIL (2025-08-19 07:23:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 3.244713956s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
133.182334ms
FAIL (2025-08-19 07:23:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 133.208444ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
123.894259ms
FAIL (2025-08-19 07:22:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.928623ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.237736752s
FAIL (2025-08-19 07:22:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 1.237755849s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
105.412203ms
FAIL (2025-08-19 07:22:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 105.429106ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.267956135s
FAIL (2025-08-19 07:21:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 1.267981813s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
115.5388ms
FAIL (2025-08-19 07:21:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 115.56029ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
596.393868ms
FAIL (2025-08-19 07:21:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 596.418644ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X.....................................X.....................] duration:
115.8849ms
FAIL (2025-08-19 07:21:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 115.899316ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.038805241s
FAIL (2025-08-19 07:20:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 1.038875093s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.....................................X....................] duration:
381.375832ms
FAIL (2025-08-19 07:19:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 381.399428ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
809.980378ms
FAIL (2025-08-19 07:19:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 809.9974ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.....................................X...................] duration:
121.387036ms
FAIL (2025-08-19 07:19:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 121.411501ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.299743422s
FAIL (2025-08-19 07:18:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 1.299771875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.....................................X..................] duration:
248.528815ms
FAIL (2025-08-19 07:18:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 248.548292ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.....................................X.................] duration:
113.241964ms
FAIL (2025-08-19 07:17:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 113.265989ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
760.455753ms
FAIL (2025-08-19 07:17:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 760.490877ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.127369923s
FAIL (2025-08-19 07:17:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 1.12739539s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X....X.....................................X................] duration:
353.119714ms
FAIL (2025-08-19 07:17:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 353.17078ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
829.908397ms
FAIL (2025-08-19 07:16:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 829.929447ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X....X.....................................X...............] duration:
153.245626ms
FAIL (2025-08-19 07:16:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.272957ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.126252779s
FAIL (2025-08-19 07:15:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 06:44:21.145397660 (253h18m1.87666529s) [upload=263452]: Starting upload
Aug 19 06:44:21.145459867 (253h18m1.876727498s) [upload=263452]: Done starting upload
Aug 19 06:44:21.145507988 (253h18m1.876775608s) [upload=263452]: Uploading segments...
Aug 19 06:44:21.145820077 (253h18m1.877087696s) [upload=263452]: Got next segment. Inline: false
Aug 19 06:44:21.145852557 (253h18m1.877120187s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 06:44:21.145856685 (253h18m1.877124305s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 06:44:21.238527821 (253h18m1.969795452s) [seg_pos={0 0}, upload=263452]: Begin upload segment...
Aug 19 06:44:21.238559842 (253h18m1.969827472s) [seg_pos={0 0}, upload=263452]: Done begin upload segment.
Aug 19 06:44:21.238580070 (253h18m1.9698477s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238609926 (253h18m1.969877545s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238881186 (253h18m1.970148806s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.238924418 (253h18m1.970192038s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239095120 (253h18m1.97036275s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239151375 (253h18m1.970418995s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239298523 (253h18m1.970566153s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239362052 (253h18m1.970629682s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239499882 (253h18m1.970767512s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239633343 (253h18m1.970900963s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239703305 (253h18m1.970970925s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239879416 (253h18m1.971147036s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.239954979 (253h18m1.971222609s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240192615 (253h18m1.971460236s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240280341 (253h18m1.971547961s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240410677 (253h18m1.971678296s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240516927 (253h18m1.971784547s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.240722023 (253h18m1.971989642s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Uploading piece...
Aug 19 06:44:21.303439125 (253h18m2.034706744s) [upload=263452]: Next returned nil segment
Aug 19 06:44:21.303451608 (253h18m2.034719228s) [upload=263452]: Waiting for error group managing segments...
Aug 19 06:44:21.311624077 (253h18m2.042891707s) [noise=true , address=79.127.219.47:4062 , piece_id=47VK7RI2RY6QTH4KD3S2WJKADGEECNZGNQSCXJ4Z63GOBR7GFFEA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.312009522 (253h18m2.043277142s) [noise=true , address=79.127.219.38:4023 , piece_id=RCTMR63HIO6OBXHOKNNGJWTT6LFHQR2OLT35CWZVFLMSUECGYUJA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.496593167 (253h18m2.227860797s) [noise=true , address=79.127.201.215:4355 , piece_id=5SPLM6OCZ4UMOUWSF65LSUBIWTK4WRHBBFNQ44AGJLJNUFKAU4HA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.535854259 (253h18m2.267121879s) [noise=true , address=104.36.82.34:4569 , piece_id=ZFO735ULOVAWGMRNJV2TU3F4FLI7KODLRPFBCBXJ2WO6UKHTZRHQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.564793333 (253h18m2.296060953s) [noise=true , address=104.36.82.60:4353 , piece_id=J24ESNC5KEX6LC26KDVAKHP42YIWQG6LK5F4XCKAPLRHCWG2GJ2A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.820077130 (253h18m2.55134478s) [noise=true , address=66.23.193.175:4554 , piece_id=WHKXD4UXXHQ2ECC6ANUELWZ4XIJAKMSTBSHKHVZYGDJZ2QLRVU3Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:21.934369422 (253h18m2.665637082s) [noise=true , address=104.36.82.5:4846 , piece_id=I3FWIHLCSOM2EUXMBSR3IADT4LTAYYT7Y3LGRZ6HMODV77LX433A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.073050226 (253h18m2.804317877s) [noise=true , address=45.91.116.12:4235 , piece_id=64BHSOO2MFIXWLJI6ZWUHI5OXVR6QGR7ODIS2O5G2X3IVVN7YTUQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:22.135094441 (253h18m2.86636209s) [noise=true , address=77.90.31.18:4831 , piece_id=EKTJ2EMFENCUNY4HBQBFJIWVKSP3YTPWD2PTJNTV6TZTDRWHLGPA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.031183342 (253h18m3.762450993s) [noise=true , address=45.91.116.4:4949 , piece_id=7XTF4QC3FMPHELJE2XWRDX53UM4TZWMONJXNXD47T6VMKWYNBYJQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.051805455 (253h18m3.783073105s) [noise=true , address=45.91.116.11:4135 , piece_id=72AQF4WVSLOKFHBQ6OZHHXQBHTGGLKPPU67DCNVRG3TI3IPY5BDA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053011285 (253h18m3.784278936s) [noise=true , address=77.90.31.19:4848 , piece_id=YHPJMA2ZAD24SPPKDHLZGK26TBFS4UVKTNG7U5XH7Y35V5F77B6Q, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.053113409 (253h18m3.784381058s) [noise=true , address=45.91.116.7:4019 , piece_id=GPXSDG3BBR3OS6ELXOICZF47AZNK2TWDA6LXFSGBZLSUJU3GZMSQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080355107 (253h18m3.811622757s) [noise=true , address=45.91.116.9:4283 , piece_id=QSO5EUIUUMW4DEZ3T6R55HX5KLDT3D4OHDO77L5R4O4RWYRMCJ6A, seg_pos={0 0}, upload=263452]: Done uploading piece. err: <nil>
Aug 19 06:44:23.080383380 (253h18m3.81165104s) [seg_pos={0 0}, upload=263452]: Segment reached optimal threshold of 14 pieces.
Aug 19 06:44:23.080605940 (253h18m3.811873589s) [noise=true , address=77.90.31.16:4747 , piece_id=5QXZEQGP2WCNYKMR332LNNH2HABDX4JYKGSUVQI326W7SOUTPOQA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080698773 (253h18m3.811966434s) [noise=true , address=77.90.31.12:4624 , piece_id=MCYY2IF7BDL65PTDPEKRSREBNSBJFZZEP7MRPHQKBR36WNI3RDQQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080868624 (253h18m3.812136274s) [noise=true , address=45.91.116.5:4331 , piece_id=V73XHDAJST4MMX32ALULIVLGOE5R2Y7NMVOXKAWXA6Z3ZFUBXIBQ, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ): protocol: write tcp 5.161.89.252:36152->45.91.116.5:4331: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 19 06:44:23.080899382 (253h18m3.812167042s) [noise=true , address=104.36.82.23:4452 , piece_id=DJJ7F7BLD6ZYXBSAAW2K4DAKKPTV75N4E2FRBZSYTBSYXI2G27MA, seg_pos={0 0}, upload=263452]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 19 06:44:23.080934587 (253h18m3.812202238s) [seg_pos={0 0}, upload=263452]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 06:44:23.081027883 (253h18m3.812295544s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 06:44:23.081036379 (253h18m3.81230404s) [upload=263452]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 06:44:23.133493060 (253h18m3.86476072s) [upload=263452]: Done uploading segments...
Aug 19 06:44:23.133510112 (253h18m3.864777762s) [upload=263452]: Upload finished. err: <nil>
Duration: 1.126277275s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X....X.....................................X..............] duration:
1.456752705s
FAIL (2025-08-19 07:15:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.456810074s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X....X.....................................X.............] duration:
117.19494ms
FAIL (2025-08-19 07:14:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 07:03:09.528845418 (253h36m50.260113068s) [upload=263781]: Starting upload Aug 19 07:03:09.528914679 (253h36m50.260182339s) [upload=263781]: Done starting upload Aug 19 07:03:09.529008616 (253h36m50.260276275s) [upload=263781]: Uploading segments... Aug 19 07:03:09.529079048 (253h36m50.260346699s) [upload=263781]: Got next segment. Inline: true Aug 19 07:03:09.529086162 (253h36m50.260353812s) [upload=263781]: Waiting for error group managing segments... Aug 19 07:03:09.529140964 (253h36m50.260408615s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 07:03:09.529147667 (253h36m50.260415317s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 07:03:09.529151514 (253h36m50.260419165s) [upload=263781]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 07:03:09.531613270 (253h36m50.262880921s) [upload=263781]: Done uploading segments... Aug 19 07:03:09.531624231 (253h36m50.262891881s) [upload=263781]: Upload finished. err: metaclient: Too Many Requests
Duration: 117.213664ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|