Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
579.865346ms
FAIL (2025-08-25 05:44:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 579.886084ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
139.23109ms
FAIL (2025-08-25 05:44:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:43:44.407314158 (396h17m25.138581818s) [upload=412000]: Starting upload Aug 25 05:43:44.407402896 (396h17m25.138670546s) [upload=412000]: Done starting upload Aug 25 05:43:44.407486743 (396h17m25.138754393s) [upload=412000]: Uploading segments... Aug 25 05:43:44.407537648 (396h17m25.138805309s) [upload=412000]: Got next segment. Inline: true Aug 25 05:43:44.407546475 (396h17m25.138814125s) [upload=412000]: Waiting for error group managing segments... Aug 25 05:43:44.407605596 (396h17m25.138873246s) [upload=412000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:43:44.407611728 (396h17m25.138879378s) [upload=412000]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 05:43:44.407615234 (396h17m25.138882885s) [upload=412000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 05:43:44.416330920 (396h17m25.147598581s) [upload=412000]: Done uploading segments... Aug 25 05:43:44.416349035 (396h17m25.147616685s) [upload=412000]: Upload finished. err: metaclient: Too Many Requests
Duration: 139.25314ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
311.72496ms
FAIL (2025-08-25 05:44:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:43:44.407314158 (396h17m25.138581818s) [upload=412000]: Starting upload Aug 25 05:43:44.407402896 (396h17m25.138670546s) [upload=412000]: Done starting upload Aug 25 05:43:44.407486743 (396h17m25.138754393s) [upload=412000]: Uploading segments... Aug 25 05:43:44.407537648 (396h17m25.138805309s) [upload=412000]: Got next segment. Inline: true Aug 25 05:43:44.407546475 (396h17m25.138814125s) [upload=412000]: Waiting for error group managing segments... Aug 25 05:43:44.407605596 (396h17m25.138873246s) [upload=412000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:43:44.407611728 (396h17m25.138879378s) [upload=412000]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 05:43:44.407615234 (396h17m25.138882885s) [upload=412000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 05:43:44.416330920 (396h17m25.147598581s) [upload=412000]: Done uploading segments... Aug 25 05:43:44.416349035 (396h17m25.147616685s) [upload=412000]: Upload finished. err: metaclient: Too Many Requests
Duration: 311.749585ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
23.46486ms
FAIL (2025-08-25 05:43:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:43:44.407314158 (396h17m25.138581818s) [upload=412000]: Starting upload Aug 25 05:43:44.407402896 (396h17m25.138670546s) [upload=412000]: Done starting upload Aug 25 05:43:44.407486743 (396h17m25.138754393s) [upload=412000]: Uploading segments... Aug 25 05:43:44.407537648 (396h17m25.138805309s) [upload=412000]: Got next segment. Inline: true Aug 25 05:43:44.407546475 (396h17m25.138814125s) [upload=412000]: Waiting for error group managing segments... Aug 25 05:43:44.407605596 (396h17m25.138873246s) [upload=412000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:43:44.407611728 (396h17m25.138879378s) [upload=412000]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 05:43:44.407615234 (396h17m25.138882885s) [upload=412000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 05:43:44.416330920 (396h17m25.147598581s) [upload=412000]: Done uploading segments... Aug 25 05:43:44.416349035 (396h17m25.147616685s) [upload=412000]: Upload finished. err: metaclient: Too Many Requests
Duration: 23.492192ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.191074603s
FAIL (2025-08-25 05:43:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.191100783s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
715.345487ms
FAIL (2025-08-25 05:42:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 715.369181ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.3770906s
FAIL (2025-08-25 05:42:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.377111129s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.19471759s
FAIL (2025-08-25 05:41:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.19473893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.271940958s
FAIL (2025-08-25 05:40:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.271959362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
313.735862ms
FAIL (2025-08-25 05:39:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 313.807907ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.343924711s
FAIL (2025-08-25 05:39:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.343968183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
691.449068ms
FAIL (2025-08-25 05:38:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 691.477491ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.077767889s
FAIL (2025-08-25 05:38:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.077793606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
27.432622ms
FAIL (2025-08-25 05:37:10 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 05:37:10.911964861 (396h10m51.643232481s) [upload=411883]: Starting upload Aug 25 05:37:10.912028641 (396h10m51.643296271s) [upload=411883]: Done starting upload Aug 25 05:37:10.912137856 (396h10m51.643405486s) [upload=411883]: Uploading segments... Aug 25 05:37:10.912290813 (396h10m51.643558444s) [upload=411883]: Got next segment. Inline: false Aug 25 05:37:10.912333103 (396h10m51.643600733s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 05:37:10.912338272 (396h10m51.643605893s) [upload=411883]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 25 05:37:10.923929611 (396h10m51.655197241s) [upload=411883]: Next segment err: metaclient: Too Many Requests Aug 25 05:37:10.923954748 (396h10m51.655222368s) [upload=411883]: Done uploading segments... Aug 25 05:37:10.923970728 (396h10m51.655238348s) [upload=411883]: Upload finished. err: metaclient: Too Many Requests
Duration: 27.452069ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.477688977s
FAIL (2025-08-25 05:32:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.477716278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.091818479s
FAIL (2025-08-25 05:31:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.091841742s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
747.726598ms
FAIL (2025-08-25 05:30:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 747.747407ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.284265677s
FAIL (2025-08-25 05:30:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 2.284285574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
120.432302ms
FAIL (2025-08-25 05:29:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 120.454844ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
1.501714736s
FAIL (2025-08-25 05:29:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.501746254s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.711150584s
FAIL (2025-08-25 05:29:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 2.71116927s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
171.980428ms
FAIL (2025-08-25 05:28:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 172.026024ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
433.986672ms
FAIL (2025-08-25 05:28:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 434.010346ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
154.186048ms
FAIL (2025-08-25 05:28:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.211255ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
412.662465ms
FAIL (2025-08-25 05:27:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 412.688315ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.056800124s
FAIL (2025-08-25 05:27:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.056820241s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
159.506924ms
FAIL (2025-08-25 05:27:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 159.527021ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
330.048871ms
FAIL (2025-08-25 05:26:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 330.069751ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
168.881138ms
FAIL (2025-08-25 05:26:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.904994ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.9318277s
FAIL (2025-08-25 05:25:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.931859199s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.50913444s
FAIL (2025-08-25 05:25:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.509159057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
144.107713ms
FAIL (2025-08-25 05:25:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 144.131066ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
355.730205ms
FAIL (2025-08-25 05:24:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 355.754913ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
273.411847ms
FAIL (2025-08-25 05:24:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 273.427216ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
225.796623ms
FAIL (2025-08-25 05:24:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 225.814115ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.513270993s
FAIL (2025-08-25 05:23:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.513294136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
129.685019ms
FAIL (2025-08-25 05:23:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 129.710858ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
541.072602ms
FAIL (2025-08-25 05:23:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 541.092439ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.594152529s
FAIL (2025-08-25 05:22:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.594177635s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.121228913s
FAIL (2025-08-25 05:22:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.121255954s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
390.176062ms
FAIL (2025-08-25 05:22:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 390.198454ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.681281486s
FAIL (2025-08-25 05:21:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 2.681308196s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
242.607684ms
FAIL (2025-08-25 05:21:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 242.660633ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
145.903267ms
FAIL (2025-08-25 05:21:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.933535ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
397.548393ms
FAIL (2025-08-25 05:20:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 397.56842ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
397.667514ms
FAIL (2025-08-25 05:20:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 397.687993ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
684.173186ms
FAIL (2025-08-25 05:20:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 684.196691ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.421235886s
FAIL (2025-08-25 05:19:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 25 04:50:15.177820773 (395h23m55.909088434s) [upload=411053]: Starting upload
Aug 25 04:50:15.177960475 (395h23m55.909228125s) [upload=411053]: Done starting upload
Aug 25 04:50:15.178135384 (395h23m55.909403044s) [upload=411053]: Uploading segments...
Aug 25 04:50:15.178457419 (395h23m55.90972507s) [upload=411053]: Got next segment. Inline: false
Aug 25 04:50:15.178548190 (395h23m55.90981584s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 25 04:50:15.178558378 (395h23m55.909826029s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 25 04:50:15.226781045 (395h23m55.958048756s) [seg_pos={0 0}, upload=411053]: Begin upload segment...
Aug 25 04:50:15.226850987 (395h23m55.958118638s) [seg_pos={0 0}, upload=411053]: Done begin upload segment.
Aug 25 04:50:15.226903516 (395h23m55.958171167s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227494256 (395h23m55.958761896s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.227563155 (395h23m55.958830806s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228137896 (395h23m55.959405545s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228167752 (395h23m55.959435411s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228747190 (395h23m55.96001484s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.228891912 (395h23m55.960159571s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229294367 (395h23m55.960562018s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229756416 (395h23m55.961024076s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.229849009 (395h23m55.96111666s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230404984 (395h23m55.961672634s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230637832 (395h23m55.961905482s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.230926304 (395h23m55.962193954s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231480464 (395h23m55.962748114s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.231592976 (395h23m55.962860627s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.232528925 (395h23m55.963796575s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.233479691 (395h23m55.964747381s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.234423284 (395h23m55.965691014s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Uploading piece...
Aug 25 04:50:15.351374382 (395h23m56.082642022s) [upload=411053]: Next returned nil segment
Aug 25 04:50:15.351530706 (395h23m56.082798346s) [upload=411053]: Waiting for error group managing segments...
Aug 25 04:50:15.357114717 (395h23m56.088382367s) [noise=true , address=79.127.219.51:4199 , piece_id=3JSBLNFHBI2JFDRY5RRHIBW75UNOW3OHC3PDZREEIEX2SZQPGXRA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.357971938 (395h23m56.089239578s) [noise=true , address=77.90.31.18:4813 , piece_id=64KZYVUEH6KCVGG6J5IWTQ7MFB553D6VJ3OJ7MDA5O3CYRQ6IB5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359299782 (395h23m56.090567422s) [noise=true , address=77.90.31.11:4566 , piece_id=OAYZFI346NRAOIEVOGIKUGTF4PGQORDI7QZX2BB2HVVL5ANUCBQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359603232 (395h23m56.090870882s) [noise=true , address=104.36.82.23:4478 , piece_id=CBNIR3T4WSZL37EIST7HHOM3RL7C3J4EHQVVN34O3G4UYYRUB47Q, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.359782398 (395h23m56.091050038s) [noise=true , address=77.90.31.12:4611 , piece_id=JEMYI5BAKWGYTAYD7SZDSZKUWI6S6HJCD5Q4H74LUSE6DZM26JYQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360459782 (395h23m56.091727412s) [noise=true , address=77.90.31.14:4678 , piece_id=M56XPFYTVJMCTGJN5YEI2ADBJNIL3DGMLXITWTGUFI4PJQIABBFQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.360540383 (395h23m56.091808023s) [noise=true , address=77.90.31.13:4637 , piece_id=3AKGZNAPG4KSRF74SPUSJXPNEDMYQ2MZJKH3JO4T4JK6SQS3BK3A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361602688 (395h23m56.092870328s) [noise=true , address=45.91.116.6:4999 , piece_id=JSJHCIH5QWJEK4BUFMDLXNB6BSJWRNCA2XNEZ7WPQLTU6N2GIVCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.361684892 (395h23m56.092952532s) [noise=true , address=104.36.82.21:4494 , piece_id=B6GQKZYGE3IHTGTUJPUI7LVNQWZHOO66VPE5GWBWD63UMXWSFMSQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.362446934 (395h23m56.093714564s) [noise=true , address=104.36.82.53:4130 , piece_id=UP6B6WQ6F4YZMQU2TJQUUHRDJRQRUVFWS45SEIKNLVKPKU5MZW5A, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363070035 (395h23m56.094337675s) [noise=true , address=104.36.82.12:4169 , piece_id=IY65JXWQ4I6Q4AV44NHOHRDM3Q4AGZLP32WG6677HWBE7FAXIDPA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.363939449 (395h23m56.095207088s) [noise=true , address=104.36.82.6:4899 , piece_id=QXUWLJSIMCSXIVUWPX3UWOLVF5T2KQYN3AN4BI3LQPAJPUGRRXCQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364447723 (395h23m56.095715363s) [noise=true , address=104.36.82.60:4338 , piece_id=NX7JXOFP6RXXBOWR2KNSAHBGR52KEFTVJ4JPLIRWEHPZETYVDICQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364477899 (395h23m56.095745539s) [noise=true , address=104.36.82.44:4883 , piece_id=K42VU5PZDMRXGPK5S3ABHNUPC3NZ2XWQ23WFMDPLVLHU3ZGTZSBA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.364491306 (395h23m56.095758946s) [seg_pos={0 0}, upload=411053]: Segment reached optimal threshold of 14 pieces.
Aug 25 04:50:15.364889193 (395h23m56.096156833s) [noise=true , address=45.91.116.14:4213 , piece_id=XXX7QGCHZEZHQVYAVJLSIT6TKFEZTIUVGOPQI5WSHPPGVVSSMEQA, seg_pos={0 0}, upload=411053]: Done uploading piece. err: <nil>
Aug 25 04:50:15.365075813 (395h23m56.096343453s) [noise=true , address=79.127.220.98:4401 , piece_id=Q5PJUOEUQH42RMMJB5N7YT3VELEEBFGVYKCJCWMFLAKQCU7NMAHQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nBeZ8PtTmwnbqPgJLj5FuKr91vUJK98kSQ1oPheAp72GgRGxP): protocol: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:29270->79.127.220.98:4401: use of closed network connection
Aug 25 04:50:15.365083607 (395h23m56.096351248s) [noise=true , address=79.127.201.215:4350 , piece_id=HKX2U7NI3O6IXRKQAOQE2WFNUOPTA2ANC4UW6DWWSURM3FFJC6UQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: read tcp 5.161.89.252:17146->79.127.201.215:4350: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365131108 (395h23m56.096398748s) [noise=true , address=79.127.205.246:4275 , piece_id=J5IGCFGFKMFZTEVRI3BHROZ4VZV6JBHVZEIPGZUZU4HO72R2TCPQ, seg_pos={0 0}, upload=411053]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C5iC41WLH6gX28BYQRtiYm5St3dmfPk8n28B3jkd1UwgmAfoN): protocol: read tcp 5.161.89.252:41524->79.127.205.246:4275: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 25 04:50:15.365165953 (395h23m56.096433623s) [seg_pos={0 0}, upload=411053]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 25 04:50:15.365247676 (395h23m56.096515317s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 25 04:50:15.365253006 (395h23m56.096520636s) [upload=411053]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 25 04:50:15.428623221 (395h23m56.159890872s) [upload=411053]: Done uploading segments...
Aug 25 04:50:15.428640974 (395h23m56.159908625s) [upload=411053]: Upload finished. err: <nil>
Duration: 1.421259731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
138.043613ms
FAIL (2025-08-25 05:19:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 138.072649ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
149.465552ms
FAIL (2025-08-25 05:18:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 25 04:46:41.423633041 (395h20m22.1549007s) [upload=410987]: Starting upload Aug 25 04:46:41.423738378 (395h20m22.155006038s) [upload=410987]: Done starting upload Aug 25 04:46:41.423841782 (395h20m22.155109442s) [upload=410987]: Uploading segments... Aug 25 04:46:41.423993358 (395h20m22.155261068s) [upload=410987]: Got next segment. Inline: true Aug 25 04:46:41.424013886 (395h20m22.155281546s) [upload=410987]: Waiting for error group managing segments... Aug 25 04:46:41.424102162 (395h20m22.155369811s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 25 04:46:41.424111629 (395h20m22.15537929s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 25 04:46:41.424115647 (395h20m22.155383297s) [upload=410987]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 25 04:46:41.430767062 (395h20m22.162034723s) [upload=410987]: Done uploading segments... Aug 25 04:46:41.430784315 (395h20m22.162051965s) [upload=410987]: Upload finished. err: metaclient: Too Many Requests
Duration: 149.49119ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|