Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
487.443737ms
FAIL (2025-08-18 18:35:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:32:54.190605854 (241h6m34.921873514s) [upload=250780]: Starting upload Aug 18 18:32:54.190671508 (241h6m34.921939158s) [upload=250780]: Done starting upload Aug 18 18:32:54.190755486 (241h6m34.922023135s) [upload=250780]: Uploading segments... Aug 18 18:32:54.191070808 (241h6m34.922338458s) [upload=250780]: Got next segment. Inline: false Aug 18 18:32:54.191125310 (241h6m34.922392971s) [upload=250780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:32:54.191131051 (241h6m34.922398701s) [upload=250780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:32:54.193185281 (241h6m34.924452931s) [upload=250780]: Next segment err: metaclient: Too Many Requests Aug 18 18:32:54.193204277 (241h6m34.924471926s) [upload=250780]: Done uploading segments... Aug 18 18:32:54.193217802 (241h6m34.924485452s) [upload=250780]: Upload finished. err: metaclient: Too Many Requests
Duration: 487.462984ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
707.836297ms
FAIL (2025-08-18 18:34:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:32:54.190605854 (241h6m34.921873514s) [upload=250780]: Starting upload Aug 18 18:32:54.190671508 (241h6m34.921939158s) [upload=250780]: Done starting upload Aug 18 18:32:54.190755486 (241h6m34.922023135s) [upload=250780]: Uploading segments... Aug 18 18:32:54.191070808 (241h6m34.922338458s) [upload=250780]: Got next segment. Inline: false Aug 18 18:32:54.191125310 (241h6m34.922392971s) [upload=250780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:32:54.191131051 (241h6m34.922398701s) [upload=250780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:32:54.193185281 (241h6m34.924452931s) [upload=250780]: Next segment err: metaclient: Too Many Requests Aug 18 18:32:54.193204277 (241h6m34.924471926s) [upload=250780]: Done uploading segments... Aug 18 18:32:54.193217802 (241h6m34.924485452s) [upload=250780]: Upload finished. err: metaclient: Too Many Requests
Duration: 707.86486ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
656.583596ms
FAIL (2025-08-18 18:33:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:32:54.190605854 (241h6m34.921873514s) [upload=250780]: Starting upload Aug 18 18:32:54.190671508 (241h6m34.921939158s) [upload=250780]: Done starting upload Aug 18 18:32:54.190755486 (241h6m34.922023135s) [upload=250780]: Uploading segments... Aug 18 18:32:54.191070808 (241h6m34.922338458s) [upload=250780]: Got next segment. Inline: false Aug 18 18:32:54.191125310 (241h6m34.922392971s) [upload=250780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:32:54.191131051 (241h6m34.922398701s) [upload=250780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:32:54.193185281 (241h6m34.924452931s) [upload=250780]: Next segment err: metaclient: Too Many Requests Aug 18 18:32:54.193204277 (241h6m34.924471926s) [upload=250780]: Done uploading segments... Aug 18 18:32:54.193217802 (241h6m34.924485452s) [upload=250780]: Upload finished. err: metaclient: Too Many Requests
Duration: 656.632738ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
16.262734ms
FAIL (2025-08-18 18:32:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 18:32:54.190605854 (241h6m34.921873514s) [upload=250780]: Starting upload Aug 18 18:32:54.190671508 (241h6m34.921939158s) [upload=250780]: Done starting upload Aug 18 18:32:54.190755486 (241h6m34.922023135s) [upload=250780]: Uploading segments... Aug 18 18:32:54.191070808 (241h6m34.922338458s) [upload=250780]: Got next segment. Inline: false Aug 18 18:32:54.191125310 (241h6m34.922392971s) [upload=250780]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 18:32:54.191131051 (241h6m34.922398701s) [upload=250780]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 18 18:32:54.193185281 (241h6m34.924452931s) [upload=250780]: Next segment err: metaclient: Too Many Requests Aug 18 18:32:54.193204277 (241h6m34.924471926s) [upload=250780]: Done uploading segments... Aug 18 18:32:54.193217802 (241h6m34.924485452s) [upload=250780]: Upload finished. err: metaclient: Too Many Requests
Duration: 16.28205ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
138.063063ms
FAIL (2025-08-18 17:32:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 138.081777ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
164.52815ms
FAIL (2025-08-18 17:30:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.580388ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
312.220286ms
FAIL (2025-08-18 17:30:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 312.246656ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
148.581269ms
FAIL (2025-08-18 17:29:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.598341ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
132.444821ms
FAIL (2025-08-18 17:27:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 132.4704ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
143.513772ms
FAIL (2025-08-18 17:27:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 143.534991ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
189.921022ms
FAIL (2025-08-18 17:26:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 189.946209ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
220.289874ms
FAIL (2025-08-18 17:26:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 220.359364ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
164.181908ms
FAIL (2025-08-18 17:25:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.199081ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
332.085333ms
FAIL (2025-08-18 17:24:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 332.11046ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
240.816293ms
FAIL (2025-08-18 17:24:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 240.832414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
135.275584ms
FAIL (2025-08-18 17:23:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 135.287266ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
147.658073ms
FAIL (2025-08-18 17:21:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.682128ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
457.147595ms
FAIL (2025-08-18 17:20:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 457.172062ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
267.687766ms
FAIL (2025-08-18 17:19:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 267.709527ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
243.452178ms
FAIL (2025-08-18 17:19:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 243.477244ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
198.170509ms
FAIL (2025-08-18 17:18:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 198.201747ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
393.538364ms
FAIL (2025-08-18 17:17:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 393.566357ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
695.533441ms
FAIL (2025-08-18 17:17:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 695.558057ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.033229397s
FAIL (2025-08-18 17:17:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 1.03325195s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
138.649463ms
FAIL (2025-08-18 17:16:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 138.66922ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
365.672413ms
FAIL (2025-08-18 17:16:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 365.695887ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
478.590403ms
FAIL (2025-08-18 17:16:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 478.624867ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
375.914796ms
FAIL (2025-08-18 17:15:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 375.976414ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
239.97805ms
FAIL (2025-08-18 17:15:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 240.004612ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
530.849154ms
FAIL (2025-08-18 17:15:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 530.877056ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
182.899309ms
FAIL (2025-08-18 17:15:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 182.918136ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
676.726184ms
FAIL (2025-08-18 17:14:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 676.753526ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
367.562536ms
FAIL (2025-08-18 17:14:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 367.583875ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
240.068154ms
FAIL (2025-08-18 17:13:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 240.088112ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.....X.....................................................] duration:
1.118662829s
FAIL (2025-08-18 17:13:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 1.118691343s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.....X....................................................] duration:
547.788918ms
FAIL (2025-08-18 17:12:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 547.807182ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
221.134751ms
FAIL (2025-08-18 17:12:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 221.150331ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.....X...................................................] duration:
1.033122019s
FAIL (2025-08-18 17:12:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 1.033142447s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
565.008073ms
FAIL (2025-08-18 17:11:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 565.027319ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
128.924982ms
FAIL (2025-08-18 17:11:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.954078ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.....X..................................................] duration:
626.491017ms
FAIL (2025-08-18 17:11:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 626.51977ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.....X.................................................] duration:
515.060542ms
FAIL (2025-08-18 17:10:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 515.08094ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
123.606984ms
FAIL (2025-08-18 17:10:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.627032ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....X................................................] duration:
955.560896ms
FAIL (2025-08-18 17:10:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 955.584991ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
259.803448ms
FAIL (2025-08-18 17:09:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 259.817203ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
234.949007ms
FAIL (2025-08-18 17:09:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 234.970468ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
859.467159ms
FAIL (2025-08-18 17:09:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.48331ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.....X...............................................] duration:
556.488551ms
FAIL (2025-08-18 17:08:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 556.514088ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
503.344617ms
FAIL (2025-08-18 17:08:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 16:50:22.455201622 (239h24m3.186469242s) [upload=249033]: Starting upload Aug 18 16:50:22.455242599 (239h24m3.18651022s) [upload=249033]: Done starting upload Aug 18 16:50:22.455297081 (239h24m3.186564711s) [upload=249033]: Uploading segments... Aug 18 16:50:22.455322059 (239h24m3.186589678s) [upload=249033]: Got next segment. Inline: true Aug 18 16:50:22.455325595 (239h24m3.186593225s) [upload=249033]: Waiting for error group managing segments... Aug 18 16:50:22.455355953 (239h24m3.186623583s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 16:50:22.455359670 (239h24m3.18662729s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 16:50:22.455362105 (239h24m3.186629725s) [upload=249033]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 16:50:22.457793706 (239h24m3.189061346s) [upload=249033]: Done uploading segments... Aug 18 16:50:22.457802943 (239h24m3.189070583s) [upload=249033]: Upload finished. err: metaclient: Too Many Requests
Duration: 503.367849ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.....X..............................................] duration:
427.515835ms
FAIL (2025-08-18 17:08:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64d462567c51af6d9b624cb5865bdffa7555db7b90aeb23b7ae4479d50eac861 != before 6eecad395d421d06136f3311231a1e2d3e8557f8f901305f1593d024374e727a
======LOGS======
Aug 18 16:34:22.214255888 (239h8m2.945523538s) [upload=248756]: Starting upload
Aug 18 16:34:22.214353812 (239h8m2.945621442s) [upload=248756]: Done starting upload
Aug 18 16:34:22.214418823 (239h8m2.945686444s) [upload=248756]: Uploading segments...
Aug 18 16:34:22.214783459 (239h8m2.94605108s) [upload=248756]: Got next segment. Inline: false
Aug 18 16:34:22.214826430 (239h8m2.94609405s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 18 16:34:22.214831279 (239h8m2.946098899s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 18 16:34:22.655597428 (239h8m3.386865058s) [seg_pos={0 0}, upload=248756]: Begin upload segment...
Aug 18 16:34:22.655630331 (239h8m3.386897961s) [seg_pos={0 0}, upload=248756]: Done begin upload segment.
Aug 18 16:34:22.655648695 (239h8m3.386916325s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655780432 (239h8m3.387048082s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.655951924 (239h8m3.387219554s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656245847 (239h8m3.387513477s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656483063 (239h8m3.387750683s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656499674 (239h8m3.387767334s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.656750867 (239h8m3.388018487s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657064396 (239h8m3.388332016s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657243713 (239h8m3.388511373s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657298286 (239h8m3.388565906s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657514422 (239h8m3.388782052s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657712585 (239h8m3.388980235s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.657749464 (239h8m3.389017084s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658276746 (239h8m3.389544406s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.658837279 (239h8m3.390104939s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659238013 (239h8m3.390505673s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.659679072 (239h8m3.390946722s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.660362657 (239h8m3.391630307s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Uploading piece...
Aug 18 16:34:22.762984030 (239h8m3.494251649s) [upload=248756]: Next returned nil segment
Aug 18 16:34:22.762996874 (239h8m3.494264494s) [upload=248756]: Waiting for error group managing segments...
Aug 18 16:34:22.775602041 (239h8m3.506869731s) [noise=true , address=45.91.116.8:4076 , piece_id=Q2HUUZCDCXRZ5UNPJIFEITFGQZGD6OX4APKW6XFBIPMFDRCCAXOA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.791843445 (239h8m3.523111094s) [noise=true , address=104.36.82.23:4479 , piece_id=Q25YN7UCHVBTYD22WIX4RTH6X63QFWYS2X2GQ3N4L4JPJKCECJVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.794626666 (239h8m3.525894317s) [noise=true , address=104.36.82.21:4487 , piece_id=L7WICXPJEXDSG5IHFZYVINAFLKSWYE7CDGCXS7NKRPRR5QNJNZBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.809984199 (239h8m3.541251848s) [noise=true , address=104.36.82.2:4749 , piece_id=CAFEA55D6EH5OWX2CDXQIISF77WDDMAD47ZZD3GXLF7J4NNGRHBA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.815346168 (239h8m3.546613818s) [noise=true , address=77.90.31.19:4846 , piece_id=WTROZHXS7IKLBRL4SESMTIQNSXNUSEWT25EDKVUYVBTV5KPADDIQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.818382807 (239h8m3.549650467s) [noise=true , address=104.36.82.18:4386 , piece_id=B45VLA5FJLW6A2C56WYG5SQAOLIAIAYVIFHJV6RIGWLUTNPXYSVQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.819568395 (239h8m3.550836046s) [noise=true , address=104.36.82.38:4690 , piece_id=D3LU4HHDHE6OT2WDKTUIZ7QV4NXQVI2YLQQTTHN2K6VMQZ7Z7ANQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.823155579 (239h8m3.55442323s) [noise=true , address=104.36.82.8:4977 , piece_id=X3DNJLM6LER6NULEPI6LUOGG7STDYKANBJYLRNVKTDMBNS7BO3DQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.825292287 (239h8m3.556559947s) [noise=true , address=104.36.82.60:4338 , piece_id=EW47A33DULPUK6BCWH4QNNBYEG7NUVGM3NUWVJV7GQL23PUDN3YQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.826512009 (239h8m3.55777966s) [noise=true , address=104.36.82.38:4722 , piece_id=OQMOUURH6FMY2BT4BFZLWFNCQ5Y5JJEJAA6OWYIFIKNKEEZKVBZQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.831395270 (239h8m3.56266292s) [noise=true , address=77.90.31.18:4823 , piece_id=H27OEVI46553WYOYHGRAI6OPTUCP7IP7KYMMGMR4HPKDS77GNNUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.840636022 (239h8m3.571903672s) [noise=true , address=45.91.116.10:4099 , piece_id=RT5PKHRLS55XVTPMWPKHO3HQQJHIS4MOMD6W46JEOHYQXOCER3YA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.876979697 (239h8m3.608247347s) [noise=true , address=104.36.82.18:4377 , piece_id=4PR5N2K4Z3DLYJXJUUR6BHC5BY7LQIG6JCCICU2UZNFNI2BP4JUQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.886970178 (239h8m3.618237828s) [noise=true , address=77.90.31.13:4635 , piece_id=O26DELLW3YMXZZMWJUMDXBCIYAZWEGYIZL67EGEAJUVS4JSFSU5A, seg_pos={0 0}, upload=248756]: Done uploading piece. err: <nil>
Aug 18 16:34:22.887033958 (239h8m3.618301607s) [seg_pos={0 0}, upload=248756]: Segment reached optimal threshold of 14 pieces.
Aug 18 16:34:22.887338350 (239h8m3.618606001s) [noise=true , address=104.36.82.12:4177 , piece_id=NYC64YAAOONGMZG5LG4CH5XXCZHYX3Q45N62FK3UWCQMMKHYQBOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rFuJ2JyBGWtaASJNnTdHoeKUY1mCfDYfJ74BkxK64U9it8FKF): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887452555 (239h8m3.618720204s) [noise=true , address=77.90.31.12:4619 , piece_id=EERHRBAGIVAIENGMABDY6MEN6KZBAQRWEKF7K6V6N2WACFGW3MOQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX): protocol: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27676->77.90.31.12:4619: use of closed network connection
Aug 18 16:34:22.887488632 (239h8m3.618756283s) [noise=true , address=104.36.82.61:4385 , piece_id=FVLWZBT7ACKQ6BYP5GQ2XP47EP2OQE3RBXSUK4CXX6AJYFLHYMFA, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WKWWwa3svATpoNY1z7LNvYmA8gA6ZFpJsk17G4c37tDJVJ2wj): protocol: expected piece hash; context canceled; EOF
Aug 18 16:34:22.887608057 (239h8m3.618875708s) [noise=true , address=79.127.205.235:4681 , piece_id=W3MG323UDQBNGCS7HXHPOOMPNNEKIC3HOFQDUPUFUFJHXZBFUSYQ, seg_pos={0 0}, upload=248756]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rNaUSswWJWd1zWAbTyLWe8XJYKwfsCm1afjXMeCfWyaF85h96): protocol: read tcp 5.161.89.252:15398->79.127.205.235:4681: use of closed network connection; conn closed: op
Aug 18 16:34:22.887639025 (239h8m3.618906675s) [seg_pos={0 0}, upload=248756]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 18 16:34:22.887721931 (239h8m3.618989571s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 18 16:34:22.887727010 (239h8m3.618994651s) [upload=248756]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 18 16:34:23.404302198 (239h8m4.135569848s) [upload=248756]: Done uploading segments...
Aug 18 16:34:23.404321905 (239h8m4.135589555s) [upload=248756]: Upload finished. err: <nil>
Duration: 427.530553ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|