Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
165.998355ms
FAIL (2025-08-16 02:42:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 166.019474ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X...........................X....X..........] duration:
521.967279ms
FAIL (2025-08-16 02:41:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 521.98921ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
425.770658ms
FAIL (2025-08-16 02:41:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 425.795093ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...........................X....X.........] duration:
500.277301ms
FAIL (2025-08-16 02:40:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 500.295404ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
205.725525ms
FAIL (2025-08-16 02:40:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 205.747065ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
145.040623ms
FAIL (2025-08-16 02:40:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.087912ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X...........................X....X........] duration:
345.220356ms
FAIL (2025-08-16 02:39:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 345.239291ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
206.3193ms
FAIL (2025-08-16 02:39:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 206.346431ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X...........................X....X.......] duration:
394.536686ms
FAIL (2025-08-16 02:39:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 394.556193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X...........................X....X......] duration:
482.713328ms
FAIL (2025-08-16 02:38:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 482.73045ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X...........................X....X.....] duration:
407.597699ms
FAIL (2025-08-16 02:38:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 407.623538ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
145.493794ms
FAIL (2025-08-16 02:38:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 145.558225ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
153.108444ms
FAIL (2025-08-16 02:37:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 153.13357ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X...........................X....X....] duration:
629.772762ms
FAIL (2025-08-16 02:37:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 629.79281ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
244.954559ms
FAIL (2025-08-16 02:36:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 244.982892ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X...........................X....X...] duration:
397.905586ms
FAIL (2025-08-16 02:36:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 397.932567ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
143.526448ms
FAIL (2025-08-16 02:36:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.5749ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
164.558208ms
FAIL (2025-08-16 02:35:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.583836ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X...........................X....X..] duration:
473.826669ms
FAIL (2025-08-16 02:35:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 473.876031ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
146.340326ms
FAIL (2025-08-16 02:34:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 146.365454ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X...........................X....X.] duration:
366.915775ms
FAIL (2025-08-16 02:34:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 366.93409ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
185.749999ms
FAIL (2025-08-16 02:33:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 185.774355ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X...........................X....X] duration:
27.091817ms
FAIL (2025-08-16 02:33:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:33:35.348474290 (177h7m16.079741941s) [upload=184343]: Starting upload Aug 16 02:33:35.348536887 (177h7m16.079804538s) [upload=184343]: Done starting upload Aug 16 02:33:35.348653196 (177h7m16.079920847s) [upload=184343]: Uploading segments... Aug 16 02:33:35.348926580 (177h7m16.080194231s) [upload=184343]: Got next segment. Inline: false Aug 16 02:33:35.348964261 (177h7m16.080231911s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:33:35.348969331 (177h7m16.08023698s) [upload=184343]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 16 02:33:35.356118294 (177h7m16.087385945s) [upload=184343]: Next segment err: metaclient: Too Many Requests Aug 16 02:33:35.356137170 (177h7m16.08740482s) [upload=184343]: Done uploading segments... Aug 16 02:33:35.356152519 (177h7m16.087420169s) [upload=184343]: Upload finished. err: metaclient: Too Many Requests
Duration: 27.121193ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X...........................X....] duration:
495.660726ms
FAIL (2025-08-16 02:33:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 02:29:56.493623987 (177h3m37.224891617s) [upload=184275]: Starting upload
Aug 16 02:29:56.493661877 (177h3m37.224929507s) [upload=184275]: Done starting upload
Aug 16 02:29:56.493705380 (177h3m37.22497301s) [upload=184275]: Uploading segments...
Aug 16 02:29:56.493929210 (177h3m37.22519684s) [upload=184275]: Got next segment. Inline: false
Aug 16 02:29:56.493957874 (177h3m37.225225505s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:29:56.493961521 (177h3m37.225229151s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:29:56.520630755 (177h3m37.251898385s) [seg_pos={0 0}, upload=184275]: Begin upload segment...
Aug 16 02:29:56.520656202 (177h3m37.251923832s) [seg_pos={0 0}, upload=184275]: Done begin upload segment.
Aug 16 02:29:56.520675238 (177h3m37.251942858s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.520986603 (177h3m37.252254233s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521205064 (177h3m37.252472694s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521413586 (177h3m37.252681216s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521625753 (177h3m37.252893384s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521844144 (177h3m37.253111775s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522059269 (177h3m37.253326899s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522274413 (177h3m37.253542043s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522481894 (177h3m37.253749524s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522684543 (177h3m37.253952173s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522986511 (177h3m37.254254131s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523269602 (177h3m37.254537233s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523483244 (177h3m37.254750864s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523690464 (177h3m37.254958094s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523930275 (177h3m37.255197895s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524146520 (177h3m37.25541415s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524349011 (177h3m37.255616632s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524557303 (177h3m37.255824923s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.611466372 (177h3m37.342733992s) [upload=184275]: Next returned nil segment
Aug 16 02:29:56.611477062 (177h3m37.342744682s) [upload=184275]: Waiting for error group managing segments...
Aug 16 02:29:56.619861066 (177h3m37.351128696s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.620934283 (177h3m37.352201903s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.621874119 (177h3m37.353141739s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.622799217 (177h3m37.354066837s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.623636140 (177h3m37.35490376s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624136330 (177h3m37.35540396s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624493530 (177h3m37.355761151s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624931013 (177h3m37.356198643s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625283946 (177h3m37.356551576s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625652519 (177h3m37.356920149s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.626089099 (177h3m37.357356729s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645200991 (177h3m37.376468621s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645295831 (177h3m37.37656345s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646906888 (177h3m37.378174518s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646924551 (177h3m37.378192181s) [seg_pos={0 0}, upload=184275]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:29:56.647047542 (177h3m37.378315162s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KvoMM3ptQXSxPhXFe3UoS145h8n3DMT9qmeaoR3bqNa8KLMm9): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647065896 (177h3m37.378333526s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647127321 (177h3m37.378394952s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection
Aug 16 02:29:56.647162768 (177h3m37.378430398s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection
Aug 16 02:29:56.647204297 (177h3m37.378471927s) [seg_pos={0 0}, upload=184275]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:29:56.647255623 (177h3m37.378523253s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:29:56.647259170 (177h3m37.3785268s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:29:56.710179041 (177h3m37.441446691s) [upload=184275]: Done uploading segments...
Aug 16 02:29:56.710198027 (177h3m37.441465677s) [upload=184275]: Upload finished. err: <nil>
Duration: 495.679832ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
363.40677ms
FAIL (2025-08-16 02:33:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 363.423832ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X...........................X...] duration:
424.803881ms
FAIL (2025-08-16 02:32:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 02:29:56.493623987 (177h3m37.224891617s) [upload=184275]: Starting upload
Aug 16 02:29:56.493661877 (177h3m37.224929507s) [upload=184275]: Done starting upload
Aug 16 02:29:56.493705380 (177h3m37.22497301s) [upload=184275]: Uploading segments...
Aug 16 02:29:56.493929210 (177h3m37.22519684s) [upload=184275]: Got next segment. Inline: false
Aug 16 02:29:56.493957874 (177h3m37.225225505s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:29:56.493961521 (177h3m37.225229151s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:29:56.520630755 (177h3m37.251898385s) [seg_pos={0 0}, upload=184275]: Begin upload segment...
Aug 16 02:29:56.520656202 (177h3m37.251923832s) [seg_pos={0 0}, upload=184275]: Done begin upload segment.
Aug 16 02:29:56.520675238 (177h3m37.251942858s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.520986603 (177h3m37.252254233s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521205064 (177h3m37.252472694s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521413586 (177h3m37.252681216s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521625753 (177h3m37.252893384s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521844144 (177h3m37.253111775s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522059269 (177h3m37.253326899s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522274413 (177h3m37.253542043s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522481894 (177h3m37.253749524s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522684543 (177h3m37.253952173s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522986511 (177h3m37.254254131s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523269602 (177h3m37.254537233s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523483244 (177h3m37.254750864s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523690464 (177h3m37.254958094s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523930275 (177h3m37.255197895s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524146520 (177h3m37.25541415s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524349011 (177h3m37.255616632s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524557303 (177h3m37.255824923s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.611466372 (177h3m37.342733992s) [upload=184275]: Next returned nil segment
Aug 16 02:29:56.611477062 (177h3m37.342744682s) [upload=184275]: Waiting for error group managing segments...
Aug 16 02:29:56.619861066 (177h3m37.351128696s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.620934283 (177h3m37.352201903s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.621874119 (177h3m37.353141739s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.622799217 (177h3m37.354066837s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.623636140 (177h3m37.35490376s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624136330 (177h3m37.35540396s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624493530 (177h3m37.355761151s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624931013 (177h3m37.356198643s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625283946 (177h3m37.356551576s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625652519 (177h3m37.356920149s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.626089099 (177h3m37.357356729s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645200991 (177h3m37.376468621s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645295831 (177h3m37.37656345s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646906888 (177h3m37.378174518s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646924551 (177h3m37.378192181s) [seg_pos={0 0}, upload=184275]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:29:56.647047542 (177h3m37.378315162s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KvoMM3ptQXSxPhXFe3UoS145h8n3DMT9qmeaoR3bqNa8KLMm9): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647065896 (177h3m37.378333526s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647127321 (177h3m37.378394952s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection
Aug 16 02:29:56.647162768 (177h3m37.378430398s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection
Aug 16 02:29:56.647204297 (177h3m37.378471927s) [seg_pos={0 0}, upload=184275]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:29:56.647255623 (177h3m37.378523253s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:29:56.647259170 (177h3m37.3785268s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:29:56.710179041 (177h3m37.441446691s) [upload=184275]: Done uploading segments...
Aug 16 02:29:56.710198027 (177h3m37.441465677s) [upload=184275]: Upload finished. err: <nil>
Duration: 424.834789ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
128.787693ms
FAIL (2025-08-16 02:32:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.815335ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X...........................X..] duration:
387.130289ms
FAIL (2025-08-16 02:31:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 02:29:56.493623987 (177h3m37.224891617s) [upload=184275]: Starting upload
Aug 16 02:29:56.493661877 (177h3m37.224929507s) [upload=184275]: Done starting upload
Aug 16 02:29:56.493705380 (177h3m37.22497301s) [upload=184275]: Uploading segments...
Aug 16 02:29:56.493929210 (177h3m37.22519684s) [upload=184275]: Got next segment. Inline: false
Aug 16 02:29:56.493957874 (177h3m37.225225505s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:29:56.493961521 (177h3m37.225229151s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:29:56.520630755 (177h3m37.251898385s) [seg_pos={0 0}, upload=184275]: Begin upload segment...
Aug 16 02:29:56.520656202 (177h3m37.251923832s) [seg_pos={0 0}, upload=184275]: Done begin upload segment.
Aug 16 02:29:56.520675238 (177h3m37.251942858s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.520986603 (177h3m37.252254233s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521205064 (177h3m37.252472694s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521413586 (177h3m37.252681216s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521625753 (177h3m37.252893384s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521844144 (177h3m37.253111775s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522059269 (177h3m37.253326899s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522274413 (177h3m37.253542043s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522481894 (177h3m37.253749524s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522684543 (177h3m37.253952173s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522986511 (177h3m37.254254131s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523269602 (177h3m37.254537233s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523483244 (177h3m37.254750864s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523690464 (177h3m37.254958094s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523930275 (177h3m37.255197895s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524146520 (177h3m37.25541415s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524349011 (177h3m37.255616632s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524557303 (177h3m37.255824923s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.611466372 (177h3m37.342733992s) [upload=184275]: Next returned nil segment
Aug 16 02:29:56.611477062 (177h3m37.342744682s) [upload=184275]: Waiting for error group managing segments...
Aug 16 02:29:56.619861066 (177h3m37.351128696s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.620934283 (177h3m37.352201903s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.621874119 (177h3m37.353141739s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.622799217 (177h3m37.354066837s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.623636140 (177h3m37.35490376s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624136330 (177h3m37.35540396s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624493530 (177h3m37.355761151s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624931013 (177h3m37.356198643s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625283946 (177h3m37.356551576s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625652519 (177h3m37.356920149s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.626089099 (177h3m37.357356729s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645200991 (177h3m37.376468621s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645295831 (177h3m37.37656345s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646906888 (177h3m37.378174518s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646924551 (177h3m37.378192181s) [seg_pos={0 0}, upload=184275]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:29:56.647047542 (177h3m37.378315162s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KvoMM3ptQXSxPhXFe3UoS145h8n3DMT9qmeaoR3bqNa8KLMm9): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647065896 (177h3m37.378333526s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647127321 (177h3m37.378394952s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection
Aug 16 02:29:56.647162768 (177h3m37.378430398s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection
Aug 16 02:29:56.647204297 (177h3m37.378471927s) [seg_pos={0 0}, upload=184275]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:29:56.647255623 (177h3m37.378523253s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:29:56.647259170 (177h3m37.3785268s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:29:56.710179041 (177h3m37.441446691s) [upload=184275]: Done uploading segments...
Aug 16 02:29:56.710198027 (177h3m37.441465677s) [upload=184275]: Upload finished. err: <nil>
Duration: 387.152219ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
133.817934ms
FAIL (2025-08-16 02:31:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 133.839054ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
163.62816ms
FAIL (2025-08-16 02:31:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 163.646836ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
219.827723ms
FAIL (2025-08-16 02:30:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 219.843814ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X...........................X.] duration:
912.075984ms
FAIL (2025-08-16 02:30:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 02:29:56.493623987 (177h3m37.224891617s) [upload=184275]: Starting upload
Aug 16 02:29:56.493661877 (177h3m37.224929507s) [upload=184275]: Done starting upload
Aug 16 02:29:56.493705380 (177h3m37.22497301s) [upload=184275]: Uploading segments...
Aug 16 02:29:56.493929210 (177h3m37.22519684s) [upload=184275]: Got next segment. Inline: false
Aug 16 02:29:56.493957874 (177h3m37.225225505s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:29:56.493961521 (177h3m37.225229151s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:29:56.520630755 (177h3m37.251898385s) [seg_pos={0 0}, upload=184275]: Begin upload segment...
Aug 16 02:29:56.520656202 (177h3m37.251923832s) [seg_pos={0 0}, upload=184275]: Done begin upload segment.
Aug 16 02:29:56.520675238 (177h3m37.251942858s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.520986603 (177h3m37.252254233s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521205064 (177h3m37.252472694s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521413586 (177h3m37.252681216s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521625753 (177h3m37.252893384s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521844144 (177h3m37.253111775s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522059269 (177h3m37.253326899s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522274413 (177h3m37.253542043s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522481894 (177h3m37.253749524s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522684543 (177h3m37.253952173s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522986511 (177h3m37.254254131s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523269602 (177h3m37.254537233s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523483244 (177h3m37.254750864s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523690464 (177h3m37.254958094s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523930275 (177h3m37.255197895s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524146520 (177h3m37.25541415s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524349011 (177h3m37.255616632s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524557303 (177h3m37.255824923s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.611466372 (177h3m37.342733992s) [upload=184275]: Next returned nil segment
Aug 16 02:29:56.611477062 (177h3m37.342744682s) [upload=184275]: Waiting for error group managing segments...
Aug 16 02:29:56.619861066 (177h3m37.351128696s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.620934283 (177h3m37.352201903s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.621874119 (177h3m37.353141739s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.622799217 (177h3m37.354066837s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.623636140 (177h3m37.35490376s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624136330 (177h3m37.35540396s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624493530 (177h3m37.355761151s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624931013 (177h3m37.356198643s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625283946 (177h3m37.356551576s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625652519 (177h3m37.356920149s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.626089099 (177h3m37.357356729s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645200991 (177h3m37.376468621s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645295831 (177h3m37.37656345s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646906888 (177h3m37.378174518s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646924551 (177h3m37.378192181s) [seg_pos={0 0}, upload=184275]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:29:56.647047542 (177h3m37.378315162s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KvoMM3ptQXSxPhXFe3UoS145h8n3DMT9qmeaoR3bqNa8KLMm9): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647065896 (177h3m37.378333526s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647127321 (177h3m37.378394952s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection
Aug 16 02:29:56.647162768 (177h3m37.378430398s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection
Aug 16 02:29:56.647204297 (177h3m37.378471927s) [seg_pos={0 0}, upload=184275]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:29:56.647255623 (177h3m37.378523253s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:29:56.647259170 (177h3m37.3785268s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:29:56.710179041 (177h3m37.441446691s) [upload=184275]: Done uploading segments...
Aug 16 02:29:56.710198027 (177h3m37.441465677s) [upload=184275]: Upload finished. err: <nil>
Duration: 912.100801ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X...........................X] duration:
255.240387ms
FAIL (2025-08-16 02:29:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 16 02:29:56.493623987 (177h3m37.224891617s) [upload=184275]: Starting upload
Aug 16 02:29:56.493661877 (177h3m37.224929507s) [upload=184275]: Done starting upload
Aug 16 02:29:56.493705380 (177h3m37.22497301s) [upload=184275]: Uploading segments...
Aug 16 02:29:56.493929210 (177h3m37.22519684s) [upload=184275]: Got next segment. Inline: false
Aug 16 02:29:56.493957874 (177h3m37.225225505s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:29:56.493961521 (177h3m37.225229151s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:29:56.520630755 (177h3m37.251898385s) [seg_pos={0 0}, upload=184275]: Begin upload segment...
Aug 16 02:29:56.520656202 (177h3m37.251923832s) [seg_pos={0 0}, upload=184275]: Done begin upload segment.
Aug 16 02:29:56.520675238 (177h3m37.251942858s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.520986603 (177h3m37.252254233s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521205064 (177h3m37.252472694s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521413586 (177h3m37.252681216s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521625753 (177h3m37.252893384s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.521844144 (177h3m37.253111775s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522059269 (177h3m37.253326899s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522274413 (177h3m37.253542043s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522481894 (177h3m37.253749524s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522684543 (177h3m37.253952173s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.522986511 (177h3m37.254254131s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523269602 (177h3m37.254537233s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523483244 (177h3m37.254750864s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523690464 (177h3m37.254958094s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.523930275 (177h3m37.255197895s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524146520 (177h3m37.25541415s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524349011 (177h3m37.255616632s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.524557303 (177h3m37.255824923s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Uploading piece...
Aug 16 02:29:56.611466372 (177h3m37.342733992s) [upload=184275]: Next returned nil segment
Aug 16 02:29:56.611477062 (177h3m37.342744682s) [upload=184275]: Waiting for error group managing segments...
Aug 16 02:29:56.619861066 (177h3m37.351128696s) [noise=true , address=77.90.31.11:4579 , piece_id=QWBQGHFZOEWHUPREDMCWLYG44JGJN2RRNZJA7K3CBVUJUTIEK7WQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.620934283 (177h3m37.352201903s) [noise=true , address=77.90.31.13:4637 , piece_id=OZQKYLA7VTOD6EXYJB5WS42RT2LTBRTI3R5UIMRLMSUYLP4ZTY2A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.621874119 (177h3m37.353141739s) [noise=true , address=77.90.31.15:4719 , piece_id=TGPZQPTNFNNZMYSXMDCYNMFV3HQU2EIGUDA6IECM45K6IDRJR5UA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.622799217 (177h3m37.354066837s) [noise=true , address=104.36.82.18:4382 , piece_id=FUAPDJ2I2LQHUWJBWZUVX3RORCUCYQ6OYLISSF65I4DWZ4KHYKCQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.623636140 (177h3m37.35490376s) [noise=true , address=104.36.82.44:4885 , piece_id=JCJQDTUAGFPGMZLI4GH4TJX4DP5WQVZ6RFOEGLYMV3L2F42SED5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624136330 (177h3m37.35540396s) [noise=true , address=104.36.82.36:4650 , piece_id=QZVJU6OMOCRHYMFCPEOSB52XA4BQUVMYXMBYABBU4PLSGUGCXZ5A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624493530 (177h3m37.355761151s) [noise=true , address=104.36.82.20:4458 , piece_id=5TWX76QWHQPX7HFVM2665OAR5NSSA3FWLRRHPRDAMBVANLDBQJ4A, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.624931013 (177h3m37.356198643s) [noise=true , address=104.36.82.23:4448 , piece_id=NL7RK5AVCLVVK47PFOWZQYTTNDJF7VB4EKL2F26XL6FARJKIZWSQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625283946 (177h3m37.356551576s) [noise=true , address=104.36.82.3:4788 , piece_id=OKW7OGDQ35BDPNILMVFIJJFL5IBKRG3SGXQPGDYUC5F7BIMF2LUQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.625652519 (177h3m37.356920149s) [noise=true , address=104.36.82.19:4422 , piece_id=NRAVGT7H6QMTZAGYOI74OBV5EDLP7C6JRMASY5VKWZBQJGJWEPSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.626089099 (177h3m37.357356729s) [noise=true , address=104.36.82.37:4683 , piece_id=EUC6YRWHNTIA3JU3Q7FZ2LYWAGQ6PCQC6P4EDH6BJH4JZTBHCRGA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645200991 (177h3m37.376468621s) [noise=true , address=77.90.31.19:4875 , piece_id=J27POAQB26I6U2VUDSSE5TPAVGVJCWCXGH4FE7UU42OTXSUAQJZQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.645295831 (177h3m37.37656345s) [noise=true , address=104.36.82.17:4354 , piece_id=LBQ2LPZMCJKCOI35KF2LQRIHYFKLG4WXE2FLRZOUVZZJAJJ5Q7TQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646906888 (177h3m37.378174518s) [noise=true , address=104.36.82.59:4324 , piece_id=HUY2YFP56VPYZAEHOP3Y4ZISOQ45F67BFWDETVLOWNSCQKHRQHXA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: <nil>
Aug 16 02:29:56.646924551 (177h3m37.378192181s) [seg_pos={0 0}, upload=184275]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:29:56.647047542 (177h3m37.378315162s) [noise=true , address=45.91.116.12:4250 , piece_id=SDAGEFEFJLDOC7RB4BP6365GYYXZ2IUEH425TPNUCYKFAWEW2IRQ, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KvoMM3ptQXSxPhXFe3UoS145h8n3DMT9qmeaoR3bqNa8KLMm9): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647065896 (177h3m37.378333526s) [noise=true , address=77.90.31.10:4536 , piece_id=ZCNPNX34C46P6QI3EL4PCDKJD5WEXVQ6QHCIZRRBGUIWZYXLV5MA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zwuzCLWy2q166Ld52WUG9fvXNdJWsQrg2NearHYg7pyxpXFen): protocol: expected piece hash; context canceled; EOF
Aug 16 02:29:56.647127321 (177h3m37.378394952s) [noise=true , address=104.36.82.5:4860 , piece_id=YTJFDXJM6BMWXMDQRUX4UF7RFPVT4ZH6DEG64TOAHHPYL2TMSKSA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qr9fghoRVbAvNm9AMEHhhtc7JqHWBuZerBttg3KW3J3GcDjrE): protocol: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:51980->104.36.82.5:4860: use of closed network connection
Aug 16 02:29:56.647162768 (177h3m37.378430398s) [noise=true , address=79.127.220.101:4076 , piece_id=JYJDUTPBNGBYOEPXLOPRV2CB3JKQ7XICO3646TOB4ZV5QNA2N6GA, seg_pos={0 0}, upload=184275]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16diJ16eDS6LX9gZHdM6zwyMW3UanSXniaBbFUDCVb5H9QSUbZ): protocol: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:35624->79.127.220.101:4076: use of closed network connection
Aug 16 02:29:56.647204297 (177h3m37.378471927s) [seg_pos={0 0}, upload=184275]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:29:56.647255623 (177h3m37.378523253s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:29:56.647259170 (177h3m37.3785268s) [upload=184275]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:29:56.710179041 (177h3m37.441446691s) [upload=184275]: Done uploading segments...
Aug 16 02:29:56.710198027 (177h3m37.441465677s) [upload=184275]: Upload finished. err: <nil>
Duration: 255.263731ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
212.319295ms
FAIL (2025-08-16 02:29:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 212.337087ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
591.419164ms
FAIL (2025-08-16 02:29:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e0e5b70606482bff2de977c4f782e378f2b5790cdc10159bc60607fbd9fbfaab != before 6ef320993a96873ceace61dbdd94b9858262857b43c82959eb1265f31043cf6c
======LOGS======
Aug 16 02:07:30.438763202 (176h41m11.170030832s) [upload=183882]: Starting upload
Aug 16 02:07:30.438811101 (176h41m11.170078721s) [upload=183882]: Done starting upload
Aug 16 02:07:30.438952989 (176h41m11.170220638s) [upload=183882]: Uploading segments...
Aug 16 02:07:30.439153816 (176h41m11.170421476s) [upload=183882]: Got next segment. Inline: false
Aug 16 02:07:30.439208248 (176h41m11.170475899s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:07:30.439250648 (176h41m11.170518298s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:07:30.546817926 (176h41m11.278085546s) [seg_pos={0 0}, upload=183882]: Begin upload segment...
Aug 16 02:07:30.546852030 (176h41m11.27811965s) [seg_pos={0 0}, upload=183882]: Done begin upload segment.
Aug 16 02:07:30.546872859 (176h41m11.278140478s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.546890171 (176h41m11.278157791s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547180376 (176h41m11.278448006s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547215592 (176h41m11.278483222s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547451335 (176h41m11.278718965s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547575598 (176h41m11.278843228s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547681438 (176h41m11.278949058s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547875762 (176h41m11.279143383s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547905769 (176h41m11.279173389s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548158974 (176h41m11.279426605s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548207396 (176h41m11.279475026s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548404707 (176h41m11.279672337s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548543247 (176h41m11.279810877s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548629829 (176h41m11.279897459s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548840586 (176h41m11.280108216s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548854062 (176h41m11.280121681s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549088101 (176h41m11.280355721s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549151029 (176h41m11.280418659s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.634376565 (176h41m11.365644185s) [upload=183882]: Next returned nil segment
Aug 16 02:07:30.634386884 (176h41m11.365654504s) [upload=183882]: Waiting for error group managing segments...
Aug 16 02:07:30.645390280 (176h41m11.37665791s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.645892915 (176h41m11.377160535s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.646378808 (176h41m11.377646429s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.647466643 (176h41m11.378734262s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648160065 (176h41m11.379427685s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648927167 (176h41m11.380194787s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.652830451 (176h41m11.384098081s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653673987 (176h41m11.384941617s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653848714 (176h41m11.385116324s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.657685634 (176h41m11.388953264s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.659281894 (176h41m11.390549514s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.660997267 (176h41m11.392264887s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.665988716 (176h41m11.397256337s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681088951 (176h41m11.412356572s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681108699 (176h41m11.412376318s) [seg_pos={0 0}, upload=183882]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:07:30.681210599 (176h41m11.412478229s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULxdBTceFr8RctqX6MiwYAQ84tpT9NvedPKgUvibfCb4DwK5o): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681269500 (176h41m11.41253712s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fiQJkHYDv2J4V82doFX3dg43hLpgq3c34Eng3zwqFkF5znyx): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681300970 (176h41m11.4125686s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681337689 (176h41m11.412605308s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqNLPRWY7fJRS6F9h4B4qVFv6U5jyWkCy3Um7jfjEdCShEjsD): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681365471 (176h41m11.412633101s) [seg_pos={0 0}, upload=183882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:07:30.681458646 (176h41m11.412726276s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:07:30.681463154 (176h41m11.412730774s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:07:30.731085178 (176h41m11.462352808s) [upload=183882]: Done uploading segments...
Aug 16 02:07:30.731098543 (176h41m11.462366163s) [upload=183882]: Upload finished. err: <nil>
Duration: 591.444342ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
191.511635ms
FAIL (2025-08-16 02:28:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 191.530732ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
385.20972ms
FAIL (2025-08-16 02:28:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e0e5b70606482bff2de977c4f782e378f2b5790cdc10159bc60607fbd9fbfaab != before 6ef320993a96873ceace61dbdd94b9858262857b43c82959eb1265f31043cf6c
======LOGS======
Aug 16 02:07:30.438763202 (176h41m11.170030832s) [upload=183882]: Starting upload
Aug 16 02:07:30.438811101 (176h41m11.170078721s) [upload=183882]: Done starting upload
Aug 16 02:07:30.438952989 (176h41m11.170220638s) [upload=183882]: Uploading segments...
Aug 16 02:07:30.439153816 (176h41m11.170421476s) [upload=183882]: Got next segment. Inline: false
Aug 16 02:07:30.439208248 (176h41m11.170475899s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:07:30.439250648 (176h41m11.170518298s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:07:30.546817926 (176h41m11.278085546s) [seg_pos={0 0}, upload=183882]: Begin upload segment...
Aug 16 02:07:30.546852030 (176h41m11.27811965s) [seg_pos={0 0}, upload=183882]: Done begin upload segment.
Aug 16 02:07:30.546872859 (176h41m11.278140478s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.546890171 (176h41m11.278157791s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547180376 (176h41m11.278448006s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547215592 (176h41m11.278483222s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547451335 (176h41m11.278718965s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547575598 (176h41m11.278843228s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547681438 (176h41m11.278949058s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547875762 (176h41m11.279143383s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547905769 (176h41m11.279173389s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548158974 (176h41m11.279426605s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548207396 (176h41m11.279475026s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548404707 (176h41m11.279672337s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548543247 (176h41m11.279810877s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548629829 (176h41m11.279897459s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548840586 (176h41m11.280108216s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548854062 (176h41m11.280121681s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549088101 (176h41m11.280355721s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549151029 (176h41m11.280418659s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.634376565 (176h41m11.365644185s) [upload=183882]: Next returned nil segment
Aug 16 02:07:30.634386884 (176h41m11.365654504s) [upload=183882]: Waiting for error group managing segments...
Aug 16 02:07:30.645390280 (176h41m11.37665791s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.645892915 (176h41m11.377160535s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.646378808 (176h41m11.377646429s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.647466643 (176h41m11.378734262s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648160065 (176h41m11.379427685s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648927167 (176h41m11.380194787s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.652830451 (176h41m11.384098081s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653673987 (176h41m11.384941617s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653848714 (176h41m11.385116324s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.657685634 (176h41m11.388953264s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.659281894 (176h41m11.390549514s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.660997267 (176h41m11.392264887s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.665988716 (176h41m11.397256337s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681088951 (176h41m11.412356572s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681108699 (176h41m11.412376318s) [seg_pos={0 0}, upload=183882]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:07:30.681210599 (176h41m11.412478229s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULxdBTceFr8RctqX6MiwYAQ84tpT9NvedPKgUvibfCb4DwK5o): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681269500 (176h41m11.41253712s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fiQJkHYDv2J4V82doFX3dg43hLpgq3c34Eng3zwqFkF5znyx): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681300970 (176h41m11.4125686s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681337689 (176h41m11.412605308s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqNLPRWY7fJRS6F9h4B4qVFv6U5jyWkCy3Um7jfjEdCShEjsD): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681365471 (176h41m11.412633101s) [seg_pos={0 0}, upload=183882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:07:30.681458646 (176h41m11.412726276s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:07:30.681463154 (176h41m11.412730774s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:07:30.731085178 (176h41m11.462352808s) [upload=183882]: Done uploading segments...
Aug 16 02:07:30.731098543 (176h41m11.462366163s) [upload=183882]: Upload finished. err: <nil>
Duration: 385.229057ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
197.73518ms
FAIL (2025-08-16 02:28:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 197.759586ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
516.726972ms
FAIL (2025-08-16 02:27:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e0e5b70606482bff2de977c4f782e378f2b5790cdc10159bc60607fbd9fbfaab != before 6ef320993a96873ceace61dbdd94b9858262857b43c82959eb1265f31043cf6c
======LOGS======
Aug 16 02:07:30.438763202 (176h41m11.170030832s) [upload=183882]: Starting upload
Aug 16 02:07:30.438811101 (176h41m11.170078721s) [upload=183882]: Done starting upload
Aug 16 02:07:30.438952989 (176h41m11.170220638s) [upload=183882]: Uploading segments...
Aug 16 02:07:30.439153816 (176h41m11.170421476s) [upload=183882]: Got next segment. Inline: false
Aug 16 02:07:30.439208248 (176h41m11.170475899s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:07:30.439250648 (176h41m11.170518298s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:07:30.546817926 (176h41m11.278085546s) [seg_pos={0 0}, upload=183882]: Begin upload segment...
Aug 16 02:07:30.546852030 (176h41m11.27811965s) [seg_pos={0 0}, upload=183882]: Done begin upload segment.
Aug 16 02:07:30.546872859 (176h41m11.278140478s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.546890171 (176h41m11.278157791s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547180376 (176h41m11.278448006s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547215592 (176h41m11.278483222s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547451335 (176h41m11.278718965s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547575598 (176h41m11.278843228s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547681438 (176h41m11.278949058s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547875762 (176h41m11.279143383s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547905769 (176h41m11.279173389s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548158974 (176h41m11.279426605s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548207396 (176h41m11.279475026s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548404707 (176h41m11.279672337s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548543247 (176h41m11.279810877s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548629829 (176h41m11.279897459s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548840586 (176h41m11.280108216s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548854062 (176h41m11.280121681s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549088101 (176h41m11.280355721s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549151029 (176h41m11.280418659s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.634376565 (176h41m11.365644185s) [upload=183882]: Next returned nil segment
Aug 16 02:07:30.634386884 (176h41m11.365654504s) [upload=183882]: Waiting for error group managing segments...
Aug 16 02:07:30.645390280 (176h41m11.37665791s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.645892915 (176h41m11.377160535s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.646378808 (176h41m11.377646429s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.647466643 (176h41m11.378734262s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648160065 (176h41m11.379427685s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648927167 (176h41m11.380194787s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.652830451 (176h41m11.384098081s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653673987 (176h41m11.384941617s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653848714 (176h41m11.385116324s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.657685634 (176h41m11.388953264s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.659281894 (176h41m11.390549514s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.660997267 (176h41m11.392264887s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.665988716 (176h41m11.397256337s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681088951 (176h41m11.412356572s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681108699 (176h41m11.412376318s) [seg_pos={0 0}, upload=183882]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:07:30.681210599 (176h41m11.412478229s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULxdBTceFr8RctqX6MiwYAQ84tpT9NvedPKgUvibfCb4DwK5o): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681269500 (176h41m11.41253712s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fiQJkHYDv2J4V82doFX3dg43hLpgq3c34Eng3zwqFkF5znyx): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681300970 (176h41m11.4125686s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681337689 (176h41m11.412605308s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqNLPRWY7fJRS6F9h4B4qVFv6U5jyWkCy3Um7jfjEdCShEjsD): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681365471 (176h41m11.412633101s) [seg_pos={0 0}, upload=183882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:07:30.681458646 (176h41m11.412726276s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:07:30.681463154 (176h41m11.412730774s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:07:30.731085178 (176h41m11.462352808s) [upload=183882]: Done uploading segments...
Aug 16 02:07:30.731098543 (176h41m11.462366163s) [upload=183882]: Upload finished. err: <nil>
Duration: 516.774541ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
176.315971ms
FAIL (2025-08-16 02:27:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 176.331412ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
387.308744ms
FAIL (2025-08-16 02:26:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e0e5b70606482bff2de977c4f782e378f2b5790cdc10159bc60607fbd9fbfaab != before 6ef320993a96873ceace61dbdd94b9858262857b43c82959eb1265f31043cf6c
======LOGS======
Aug 16 02:07:30.438763202 (176h41m11.170030832s) [upload=183882]: Starting upload
Aug 16 02:07:30.438811101 (176h41m11.170078721s) [upload=183882]: Done starting upload
Aug 16 02:07:30.438952989 (176h41m11.170220638s) [upload=183882]: Uploading segments...
Aug 16 02:07:30.439153816 (176h41m11.170421476s) [upload=183882]: Got next segment. Inline: false
Aug 16 02:07:30.439208248 (176h41m11.170475899s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:07:30.439250648 (176h41m11.170518298s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:07:30.546817926 (176h41m11.278085546s) [seg_pos={0 0}, upload=183882]: Begin upload segment...
Aug 16 02:07:30.546852030 (176h41m11.27811965s) [seg_pos={0 0}, upload=183882]: Done begin upload segment.
Aug 16 02:07:30.546872859 (176h41m11.278140478s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.546890171 (176h41m11.278157791s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547180376 (176h41m11.278448006s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547215592 (176h41m11.278483222s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547451335 (176h41m11.278718965s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547575598 (176h41m11.278843228s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547681438 (176h41m11.278949058s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547875762 (176h41m11.279143383s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547905769 (176h41m11.279173389s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548158974 (176h41m11.279426605s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548207396 (176h41m11.279475026s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548404707 (176h41m11.279672337s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548543247 (176h41m11.279810877s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548629829 (176h41m11.279897459s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548840586 (176h41m11.280108216s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548854062 (176h41m11.280121681s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549088101 (176h41m11.280355721s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549151029 (176h41m11.280418659s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.634376565 (176h41m11.365644185s) [upload=183882]: Next returned nil segment
Aug 16 02:07:30.634386884 (176h41m11.365654504s) [upload=183882]: Waiting for error group managing segments...
Aug 16 02:07:30.645390280 (176h41m11.37665791s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.645892915 (176h41m11.377160535s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.646378808 (176h41m11.377646429s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.647466643 (176h41m11.378734262s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648160065 (176h41m11.379427685s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648927167 (176h41m11.380194787s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.652830451 (176h41m11.384098081s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653673987 (176h41m11.384941617s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653848714 (176h41m11.385116324s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.657685634 (176h41m11.388953264s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.659281894 (176h41m11.390549514s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.660997267 (176h41m11.392264887s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.665988716 (176h41m11.397256337s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681088951 (176h41m11.412356572s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681108699 (176h41m11.412376318s) [seg_pos={0 0}, upload=183882]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:07:30.681210599 (176h41m11.412478229s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULxdBTceFr8RctqX6MiwYAQ84tpT9NvedPKgUvibfCb4DwK5o): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681269500 (176h41m11.41253712s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fiQJkHYDv2J4V82doFX3dg43hLpgq3c34Eng3zwqFkF5znyx): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681300970 (176h41m11.4125686s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681337689 (176h41m11.412605308s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqNLPRWY7fJRS6F9h4B4qVFv6U5jyWkCy3Um7jfjEdCShEjsD): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681365471 (176h41m11.412633101s) [seg_pos={0 0}, upload=183882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:07:30.681458646 (176h41m11.412726276s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:07:30.681463154 (176h41m11.412730774s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:07:30.731085178 (176h41m11.462352808s) [upload=183882]: Done uploading segments...
Aug 16 02:07:30.731098543 (176h41m11.462366163s) [upload=183882]: Upload finished. err: <nil>
Duration: 387.33353ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
137.856513ms
FAIL (2025-08-16 02:26:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 137.882802ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
901.946409ms
FAIL (2025-08-16 02:26:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e0e5b70606482bff2de977c4f782e378f2b5790cdc10159bc60607fbd9fbfaab != before 6ef320993a96873ceace61dbdd94b9858262857b43c82959eb1265f31043cf6c
======LOGS======
Aug 16 02:07:30.438763202 (176h41m11.170030832s) [upload=183882]: Starting upload
Aug 16 02:07:30.438811101 (176h41m11.170078721s) [upload=183882]: Done starting upload
Aug 16 02:07:30.438952989 (176h41m11.170220638s) [upload=183882]: Uploading segments...
Aug 16 02:07:30.439153816 (176h41m11.170421476s) [upload=183882]: Got next segment. Inline: false
Aug 16 02:07:30.439208248 (176h41m11.170475899s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:07:30.439250648 (176h41m11.170518298s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:07:30.546817926 (176h41m11.278085546s) [seg_pos={0 0}, upload=183882]: Begin upload segment...
Aug 16 02:07:30.546852030 (176h41m11.27811965s) [seg_pos={0 0}, upload=183882]: Done begin upload segment.
Aug 16 02:07:30.546872859 (176h41m11.278140478s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.546890171 (176h41m11.278157791s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547180376 (176h41m11.278448006s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547215592 (176h41m11.278483222s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547451335 (176h41m11.278718965s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547575598 (176h41m11.278843228s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547681438 (176h41m11.278949058s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547875762 (176h41m11.279143383s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547905769 (176h41m11.279173389s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548158974 (176h41m11.279426605s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548207396 (176h41m11.279475026s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548404707 (176h41m11.279672337s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548543247 (176h41m11.279810877s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548629829 (176h41m11.279897459s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548840586 (176h41m11.280108216s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548854062 (176h41m11.280121681s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549088101 (176h41m11.280355721s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549151029 (176h41m11.280418659s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.634376565 (176h41m11.365644185s) [upload=183882]: Next returned nil segment
Aug 16 02:07:30.634386884 (176h41m11.365654504s) [upload=183882]: Waiting for error group managing segments...
Aug 16 02:07:30.645390280 (176h41m11.37665791s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.645892915 (176h41m11.377160535s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.646378808 (176h41m11.377646429s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.647466643 (176h41m11.378734262s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648160065 (176h41m11.379427685s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648927167 (176h41m11.380194787s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.652830451 (176h41m11.384098081s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653673987 (176h41m11.384941617s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653848714 (176h41m11.385116324s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.657685634 (176h41m11.388953264s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.659281894 (176h41m11.390549514s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.660997267 (176h41m11.392264887s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.665988716 (176h41m11.397256337s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681088951 (176h41m11.412356572s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681108699 (176h41m11.412376318s) [seg_pos={0 0}, upload=183882]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:07:30.681210599 (176h41m11.412478229s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULxdBTceFr8RctqX6MiwYAQ84tpT9NvedPKgUvibfCb4DwK5o): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681269500 (176h41m11.41253712s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fiQJkHYDv2J4V82doFX3dg43hLpgq3c34Eng3zwqFkF5znyx): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681300970 (176h41m11.4125686s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681337689 (176h41m11.412605308s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqNLPRWY7fJRS6F9h4B4qVFv6U5jyWkCy3Um7jfjEdCShEjsD): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681365471 (176h41m11.412633101s) [seg_pos={0 0}, upload=183882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:07:30.681458646 (176h41m11.412726276s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:07:30.681463154 (176h41m11.412730774s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:07:30.731085178 (176h41m11.462352808s) [upload=183882]: Done uploading segments...
Aug 16 02:07:30.731098543 (176h41m11.462366163s) [upload=183882]: Upload finished. err: <nil>
Duration: 901.970475ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
544.472757ms
FAIL (2025-08-16 02:25:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 544.497905ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
609.324068ms
FAIL (2025-08-16 02:25:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e0e5b70606482bff2de977c4f782e378f2b5790cdc10159bc60607fbd9fbfaab != before 6ef320993a96873ceace61dbdd94b9858262857b43c82959eb1265f31043cf6c
======LOGS======
Aug 16 02:07:30.438763202 (176h41m11.170030832s) [upload=183882]: Starting upload
Aug 16 02:07:30.438811101 (176h41m11.170078721s) [upload=183882]: Done starting upload
Aug 16 02:07:30.438952989 (176h41m11.170220638s) [upload=183882]: Uploading segments...
Aug 16 02:07:30.439153816 (176h41m11.170421476s) [upload=183882]: Got next segment. Inline: false
Aug 16 02:07:30.439208248 (176h41m11.170475899s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:07:30.439250648 (176h41m11.170518298s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:07:30.546817926 (176h41m11.278085546s) [seg_pos={0 0}, upload=183882]: Begin upload segment...
Aug 16 02:07:30.546852030 (176h41m11.27811965s) [seg_pos={0 0}, upload=183882]: Done begin upload segment.
Aug 16 02:07:30.546872859 (176h41m11.278140478s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.546890171 (176h41m11.278157791s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547180376 (176h41m11.278448006s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547215592 (176h41m11.278483222s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547451335 (176h41m11.278718965s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547575598 (176h41m11.278843228s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547681438 (176h41m11.278949058s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547875762 (176h41m11.279143383s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547905769 (176h41m11.279173389s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548158974 (176h41m11.279426605s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548207396 (176h41m11.279475026s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548404707 (176h41m11.279672337s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548543247 (176h41m11.279810877s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548629829 (176h41m11.279897459s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548840586 (176h41m11.280108216s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548854062 (176h41m11.280121681s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549088101 (176h41m11.280355721s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549151029 (176h41m11.280418659s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.634376565 (176h41m11.365644185s) [upload=183882]: Next returned nil segment
Aug 16 02:07:30.634386884 (176h41m11.365654504s) [upload=183882]: Waiting for error group managing segments...
Aug 16 02:07:30.645390280 (176h41m11.37665791s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.645892915 (176h41m11.377160535s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.646378808 (176h41m11.377646429s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.647466643 (176h41m11.378734262s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648160065 (176h41m11.379427685s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648927167 (176h41m11.380194787s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.652830451 (176h41m11.384098081s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653673987 (176h41m11.384941617s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653848714 (176h41m11.385116324s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.657685634 (176h41m11.388953264s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.659281894 (176h41m11.390549514s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.660997267 (176h41m11.392264887s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.665988716 (176h41m11.397256337s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681088951 (176h41m11.412356572s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681108699 (176h41m11.412376318s) [seg_pos={0 0}, upload=183882]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:07:30.681210599 (176h41m11.412478229s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULxdBTceFr8RctqX6MiwYAQ84tpT9NvedPKgUvibfCb4DwK5o): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681269500 (176h41m11.41253712s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fiQJkHYDv2J4V82doFX3dg43hLpgq3c34Eng3zwqFkF5znyx): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681300970 (176h41m11.4125686s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681337689 (176h41m11.412605308s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqNLPRWY7fJRS6F9h4B4qVFv6U5jyWkCy3Um7jfjEdCShEjsD): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681365471 (176h41m11.412633101s) [seg_pos={0 0}, upload=183882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:07:30.681458646 (176h41m11.412726276s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:07:30.681463154 (176h41m11.412730774s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:07:30.731085178 (176h41m11.462352808s) [upload=183882]: Done uploading segments...
Aug 16 02:07:30.731098543 (176h41m11.462366163s) [upload=183882]: Upload finished. err: <nil>
Duration: 609.35184ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
154.430877ms
FAIL (2025-08-16 02:24:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 154.461325ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
558.458838ms
FAIL (2025-08-16 02:24:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e0e5b70606482bff2de977c4f782e378f2b5790cdc10159bc60607fbd9fbfaab != before 6ef320993a96873ceace61dbdd94b9858262857b43c82959eb1265f31043cf6c
======LOGS======
Aug 16 02:07:30.438763202 (176h41m11.170030832s) [upload=183882]: Starting upload
Aug 16 02:07:30.438811101 (176h41m11.170078721s) [upload=183882]: Done starting upload
Aug 16 02:07:30.438952989 (176h41m11.170220638s) [upload=183882]: Uploading segments...
Aug 16 02:07:30.439153816 (176h41m11.170421476s) [upload=183882]: Got next segment. Inline: false
Aug 16 02:07:30.439208248 (176h41m11.170475899s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:07:30.439250648 (176h41m11.170518298s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:07:30.546817926 (176h41m11.278085546s) [seg_pos={0 0}, upload=183882]: Begin upload segment...
Aug 16 02:07:30.546852030 (176h41m11.27811965s) [seg_pos={0 0}, upload=183882]: Done begin upload segment.
Aug 16 02:07:30.546872859 (176h41m11.278140478s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.546890171 (176h41m11.278157791s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547180376 (176h41m11.278448006s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547215592 (176h41m11.278483222s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547451335 (176h41m11.278718965s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547575598 (176h41m11.278843228s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547681438 (176h41m11.278949058s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547875762 (176h41m11.279143383s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547905769 (176h41m11.279173389s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548158974 (176h41m11.279426605s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548207396 (176h41m11.279475026s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548404707 (176h41m11.279672337s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548543247 (176h41m11.279810877s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548629829 (176h41m11.279897459s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548840586 (176h41m11.280108216s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548854062 (176h41m11.280121681s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549088101 (176h41m11.280355721s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549151029 (176h41m11.280418659s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.634376565 (176h41m11.365644185s) [upload=183882]: Next returned nil segment
Aug 16 02:07:30.634386884 (176h41m11.365654504s) [upload=183882]: Waiting for error group managing segments...
Aug 16 02:07:30.645390280 (176h41m11.37665791s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.645892915 (176h41m11.377160535s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.646378808 (176h41m11.377646429s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.647466643 (176h41m11.378734262s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648160065 (176h41m11.379427685s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648927167 (176h41m11.380194787s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.652830451 (176h41m11.384098081s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653673987 (176h41m11.384941617s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653848714 (176h41m11.385116324s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.657685634 (176h41m11.388953264s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.659281894 (176h41m11.390549514s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.660997267 (176h41m11.392264887s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.665988716 (176h41m11.397256337s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681088951 (176h41m11.412356572s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681108699 (176h41m11.412376318s) [seg_pos={0 0}, upload=183882]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:07:30.681210599 (176h41m11.412478229s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULxdBTceFr8RctqX6MiwYAQ84tpT9NvedPKgUvibfCb4DwK5o): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681269500 (176h41m11.41253712s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fiQJkHYDv2J4V82doFX3dg43hLpgq3c34Eng3zwqFkF5znyx): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681300970 (176h41m11.4125686s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681337689 (176h41m11.412605308s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqNLPRWY7fJRS6F9h4B4qVFv6U5jyWkCy3Um7jfjEdCShEjsD): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681365471 (176h41m11.412633101s) [seg_pos={0 0}, upload=183882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:07:30.681458646 (176h41m11.412726276s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:07:30.681463154 (176h41m11.412730774s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:07:30.731085178 (176h41m11.462352808s) [upload=183882]: Done uploading segments...
Aug 16 02:07:30.731098543 (176h41m11.462366163s) [upload=183882]: Upload finished. err: <nil>
Duration: 558.479838ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
299.522396ms
FAIL (2025-08-16 02:24:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 299.543355ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
483.942907ms
FAIL (2025-08-16 02:23:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after e0e5b70606482bff2de977c4f782e378f2b5790cdc10159bc60607fbd9fbfaab != before 6ef320993a96873ceace61dbdd94b9858262857b43c82959eb1265f31043cf6c
======LOGS======
Aug 16 02:07:30.438763202 (176h41m11.170030832s) [upload=183882]: Starting upload
Aug 16 02:07:30.438811101 (176h41m11.170078721s) [upload=183882]: Done starting upload
Aug 16 02:07:30.438952989 (176h41m11.170220638s) [upload=183882]: Uploading segments...
Aug 16 02:07:30.439153816 (176h41m11.170421476s) [upload=183882]: Got next segment. Inline: false
Aug 16 02:07:30.439208248 (176h41m11.170475899s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 02:07:30.439250648 (176h41m11.170518298s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 02:07:30.546817926 (176h41m11.278085546s) [seg_pos={0 0}, upload=183882]: Begin upload segment...
Aug 16 02:07:30.546852030 (176h41m11.27811965s) [seg_pos={0 0}, upload=183882]: Done begin upload segment.
Aug 16 02:07:30.546872859 (176h41m11.278140478s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.546890171 (176h41m11.278157791s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547180376 (176h41m11.278448006s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547215592 (176h41m11.278483222s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547451335 (176h41m11.278718965s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547575598 (176h41m11.278843228s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547681438 (176h41m11.278949058s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547875762 (176h41m11.279143383s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.547905769 (176h41m11.279173389s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548158974 (176h41m11.279426605s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548207396 (176h41m11.279475026s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548404707 (176h41m11.279672337s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548543247 (176h41m11.279810877s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548629829 (176h41m11.279897459s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548840586 (176h41m11.280108216s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.548854062 (176h41m11.280121681s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549088101 (176h41m11.280355721s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.549151029 (176h41m11.280418659s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Uploading piece...
Aug 16 02:07:30.634376565 (176h41m11.365644185s) [upload=183882]: Next returned nil segment
Aug 16 02:07:30.634386884 (176h41m11.365654504s) [upload=183882]: Waiting for error group managing segments...
Aug 16 02:07:30.645390280 (176h41m11.37665791s) [noise=true , address=77.90.31.17:4789 , piece_id=6TIFAJXOIT4PUZFXFXVPNYA3OZGJFYQTZQRDHPGPTKBN5ER7MSXA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.645892915 (176h41m11.377160535s) [noise=true , address=104.36.82.50:4022 , piece_id=LYMORSXTBVW64QH3RU52M77U2SYX4C2KHEO7LB7W3PQ6J2ASBH2A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.646378808 (176h41m11.377646429s) [noise=true , address=104.36.82.16:4305 , piece_id=BBDRZRLH5QVIJIJQ2ZMVUQNWGFC4I2NY6ESN45ICUM3ZC36NWJDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.647466643 (176h41m11.378734262s) [noise=true , address=104.36.82.39:4756 , piece_id=TP5ZCBB6O6YP55M3GR4UHZPGJDHX77GNDME25SOEXXHASJ63XZPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648160065 (176h41m11.379427685s) [noise=true , address=45.91.116.12:4230 , piece_id=6J77ZWIXD7T6R4AXHAOHZAV5IG7JIZLULPIMUG2HX73DZIHTDREQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.648927167 (176h41m11.380194787s) [noise=true , address=104.36.82.35:4588 , piece_id=WC6NC3GYA25VANFIIS5V2JUO2I66HAKEEMSIRETNEVWVAPAIXZVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.652830451 (176h41m11.384098081s) [noise=true , address=104.36.82.37:4687 , piece_id=3BB7F36AGPAEK6HYZUQ64RYJ3LE4YDCAB44U7S5WTO7232HTMX4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653673987 (176h41m11.384941617s) [noise=true , address=104.36.82.12:4170 , piece_id=V54QEKJ4OFVG2SEYCIBMUF6NEGVLIHTSFAWRB6CDTEQMCFPVLBVA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.653848714 (176h41m11.385116324s) [noise=true , address=104.36.82.18:4399 , piece_id=3UM4IKVQCSIK7LWWLXQKXI3WKONFIUS4PIOX7QE2UYVCAB6YVR4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.657685634 (176h41m11.388953264s) [noise=true , address=104.36.82.36:4622 , piece_id=JMUI23MTBKUSP2F3FTY5GB6GPZZZRVGUK4X23LHREW4YMCXSFD4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.659281894 (176h41m11.390549514s) [noise=true , address=77.90.31.11:4583 , piece_id=GAXPNUBYQDDUTNR4TN75MT5IDBWPGM6ZY53FWKT3IAC2ALRSGWBQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.660997267 (176h41m11.392264887s) [noise=true , address=104.36.82.60:4339 , piece_id=PMKE4GIV2XUKDULXAGBRAXVW3XXB7HAHXWEXRGRTRAPUJBWLKBTA, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.665988716 (176h41m11.397256337s) [noise=true , address=77.90.31.12:4595 , piece_id=PMZTJ7KSFVEU5RNONO6FZPZRI3BMUM4TVKNEHWPULGFLHR7A5SPQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681088951 (176h41m11.412356572s) [noise=true , address=104.36.82.36:4648 , piece_id=J5QNGBCDLTD5ETRDTO5ARX5DNWG5YADLEJBTQKWFIZGHIGSOUI4Q, seg_pos={0 0}, upload=183882]: Done uploading piece. err: <nil>
Aug 16 02:07:30.681108699 (176h41m11.412376318s) [seg_pos={0 0}, upload=183882]: Segment reached optimal threshold of 14 pieces.
Aug 16 02:07:30.681210599 (176h41m11.412478229s) [noise=true , address=77.90.31.16:4746 , piece_id=6WHJC4YBUNQ4BWRRZEJG34F5RWS4I54BZHB5LSTZQSAET5SDZ5DQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULxdBTceFr8RctqX6MiwYAQ84tpT9NvedPKgUvibfCb4DwK5o): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681269500 (176h41m11.41253712s) [noise=true , address=45.91.116.14:4200 , piece_id=4DYYNAQSU5POR2HXOOLNLIP2MWHVBPSRWWVTKMHMJLKGHQY3H62A, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fiQJkHYDv2J4V82doFX3dg43hLpgq3c34Eng3zwqFkF5znyx): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681300970 (176h41m11.4125686s) [noise=true , address=77.90.31.21:4912 , piece_id=IECABOD4T5D6IWNMFK6GTAMHHGVZIYI26SKDXICACOHMVFPLVRDQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SFktrdgGxzEZue49XWkNxVZfrpHA73M2H3hRX7NXnvwVnvbv1): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681337689 (176h41m11.412605308s) [noise=true , address=104.36.82.20:4466 , piece_id=XSF2Z2DAO4Z7LR4DKB72EDFGAX4A2HUALOHTJCRKYRQ3QK4IILVQ, seg_pos={0 0}, upload=183882]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SqNLPRWY7fJRS6F9h4B4qVFv6U5jyWkCy3Um7jfjEdCShEjsD): protocol: expected piece hash; context canceled; EOF
Aug 16 02:07:30.681365471 (176h41m11.412633101s) [seg_pos={0 0}, upload=183882]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 02:07:30.681458646 (176h41m11.412726276s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 02:07:30.681463154 (176h41m11.412730774s) [upload=183882]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 02:07:30.731085178 (176h41m11.462352808s) [upload=183882]: Done uploading segments...
Aug 16 02:07:30.731098543 (176h41m11.462366163s) [upload=183882]: Upload finished. err: <nil>
Duration: 483.970299ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
165.72491ms
FAIL (2025-08-16 02:23:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 02:19:00.993500357 (176h52m41.724768007s) [upload=184085]: Starting upload Aug 16 02:19:00.993567262 (176h52m41.724834913s) [upload=184085]: Done starting upload Aug 16 02:19:00.993628788 (176h52m41.724896438s) [upload=184085]: Uploading segments... Aug 16 02:19:00.993680435 (176h52m41.724948105s) [upload=184085]: Got next segment. Inline: true Aug 16 02:19:00.993686807 (176h52m41.724954457s) [upload=184085]: Waiting for error group managing segments... Aug 16 02:19:00.993729857 (176h52m41.724997508s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 02:19:00.993735147 (176h52m41.725002798s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 02:19:00.993738534 (176h52m41.725006174s) [upload=184085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 02:19:01.020523124 (176h52m41.751790744s) [upload=184085]: Done uploading segments... Aug 16 02:19:01.020541028 (176h52m41.751808648s) [upload=184085]: Upload finished. err: metaclient: Too Many Requests
Duration: 165.742874ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|