Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
161.464773ms
FAIL (2025-08-25 00:02:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 161.487626ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
345.521764ms
FAIL (2025-08-25 00:01:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 345.548736ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
598.049766ms
FAIL (2025-08-25 00:01:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 598.068331ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
163.26099ms
FAIL (2025-08-25 00:01:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 163.28224ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
3.1550007s
FAIL (2025-08-25 00:00:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 3.155020518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
148.427104ms
FAIL (2025-08-25 00:00:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.451048ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
546.859675ms
FAIL (2025-08-25 00:00:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 546.887507ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
237.343995ms
FAIL (2025-08-25 00:00:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 237.362229ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
169.130139ms
FAIL (2025-08-24 23:59:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 169.148594ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
985.207521ms
FAIL (2025-08-24 23:59:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 985.240584ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
164.531699ms
FAIL (2025-08-24 23:58:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 164.553429ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.115253481s
FAIL (2025-08-24 23:58:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 2.115286273s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
188.970336ms
FAIL (2025-08-24 23:58:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 188.993639ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.138805532s
FAIL (2025-08-24 23:57:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 2.138822575s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
134.777099ms
FAIL (2025-08-24 23:57:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 134.797587ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.98926129s
FAIL (2025-08-24 23:57:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 1.989285616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
119.758315ms
FAIL (2025-08-24 23:56:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 119.784333ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.969981026s
FAIL (2025-08-24 23:56:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 1.970003608s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
169.582259ms
FAIL (2025-08-24 23:56:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 169.606644ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.2333245s
FAIL (2025-08-24 23:55:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 1.233353673s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
128.397875ms
FAIL (2025-08-24 23:55:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 128.417602ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
155.415304ms
FAIL (2025-08-24 23:54:31 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 155.443016ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.704740343s
FAIL (2025-08-24 23:54:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 1.704766584s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
123.742677ms
FAIL (2025-08-24 23:53:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 123.767022ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.852331071s
FAIL (2025-08-24 23:53:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 1.852358481s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
339.538762ms
FAIL (2025-08-24 23:53:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 339.611839ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
130.37397ms
FAIL (2025-08-24 23:52:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 130.39538ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.345973157s
FAIL (2025-08-24 23:52:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 2.345997802s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
207.371371ms
FAIL (2025-08-24 23:52:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 207.402149ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
518.349402ms
FAIL (2025-08-24 23:51:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 518.371553ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
458.151102ms
FAIL (2025-08-24 23:51:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 458.177463ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
367.720153ms
FAIL (2025-08-24 23:51:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 367.74466ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.765626784s
FAIL (2025-08-24 23:50:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 1.765649577s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
148.328905ms
FAIL (2025-08-24 23:50:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 148.351427ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
416.900298ms
FAIL (2025-08-24 23:50:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 416.927409ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
141.128972ms
FAIL (2025-08-24 23:49:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 141.161966ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
137.224514ms
FAIL (2025-08-24 23:49:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 137.246115ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
162.747193ms
FAIL (2025-08-24 23:48:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 162.781086ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
385.785289ms
FAIL (2025-08-24 23:48:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 385.817058ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
257.192897ms
FAIL (2025-08-24 23:48:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 257.215059ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.889470801s
FAIL (2025-08-24 23:48:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 1.889499665s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
147.322794ms
FAIL (2025-08-24 23:47:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 147.351818ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
771.1427ms
FAIL (2025-08-24 23:47:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload
Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload
Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments...
Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false
Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment...
Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment.
Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece...
Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment
Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments...
Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil>
Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF
Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments...
Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil>
Duration: 771.165372ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
322.761388ms
FAIL (2025-08-24 23:46:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 322.781697ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
316.757781ms
FAIL (2025-08-24 23:46:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 316.789651ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
518.760625ms
FAIL (2025-08-24 23:44:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 518.780702ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
191.316926ms
FAIL (2025-08-24 23:43:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 191.344307ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
168.957785ms
FAIL (2025-08-24 23:43:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 168.980809ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
224.452451ms
FAIL (2025-08-24 23:42:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests
Duration: 224.473659ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.28587693s
FAIL (2025-08-24 23:42:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 24 23:02:50.804158654 (389h36m31.535426284s) [upload=405015]: Starting upload
Aug 24 23:02:50.804229579 (389h36m31.535497199s) [upload=405015]: Done starting upload
Aug 24 23:02:50.804332251 (389h36m31.535599871s) [upload=405015]: Uploading segments...
Aug 24 23:02:50.804600765 (389h36m31.535868396s) [upload=405015]: Got next segment. Inline: false
Aug 24 23:02:50.804656832 (389h36m31.535924472s) [upload=405015]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 24 23:02:50.804691056 (389h36m31.535958686s) [upload=405015]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 24 23:02:50.900195810 (389h36m31.63146344s) [seg_pos={0 0}, upload=405015]: Begin upload segment...
Aug 24 23:02:50.900252557 (389h36m31.631520187s) [seg_pos={0 0}, upload=405015]: Done begin upload segment.
Aug 24 23:02:50.900277154 (389h36m31.631544804s) [noise=true , address=104.36.82.44:4872 , piece_id=KRTR6K2BQRNN5VDLJ4T5WQWK7SBEOW3PPKSLELP2XKILD6W3SRBQ, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.900341204 (389h36m31.631608834s) [noise=true , address=45.91.116.11:4146 , piece_id=EJZUCGI22T6SEQSXUGVKD5ZDDUVJ453RP3ALFBHMGFDD54UFMDKQ, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.900386269 (389h36m31.631653899s) [noise=true , address=104.36.82.5:4868 , piece_id=2GGSJMFHPDBF3HHTEWALIQFYUNDOC7HIZJDLXFKBME5JB6XFBJ2Q, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.900769329 (389h36m31.632036969s) [noise=true , address=45.91.116.9:4270 , piece_id=KXW2UXXUOP4BHBJGZHJDGVBNF3OPW4X4K5V22XCSDTVEPJSXDTNQ, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.901022786 (389h36m31.632290416s) [noise=true , address=104.36.82.12:4165 , piece_id=ITCMXDUVRIAAIZVN6YEYL76MS2ON3RUWBYAMP7SAM5NKX3X763MA, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.901170073 (389h36m31.632437703s) [noise=true , address=104.36.82.2:4735 , piece_id=MN4EZMPF5HFPCDTUEXFDKARPLNCAMNOJC3H2YD6DJPBC32PL2KLQ, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.901545608 (389h36m31.632813228s) [noise=true , address=104.36.82.60:4350 , piece_id=5QWUV5NTZGCMYFBO6SI2PMQDVNATSTK4IZLTEAKM4EJUNSWJGDXQ, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.901844601 (389h36m31.633112231s) [noise=true , address=77.90.31.16:4763 , piece_id=WSNMUZWNOT56P5FRKZWY7T2U6CEAHMGQZH7ESMX4GMDWLW4LZM5A, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.901927185 (389h36m31.633194806s) [noise=true , address=77.90.31.14:4695 , piece_id=XULEHIAMLG2CGBGJC5MXB54KQQZKIK5VSYXUASGY3XVSHDVSHWXA, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.902347245 (389h36m31.633614866s) [noise=true , address=104.36.82.54:4191 , piece_id=HWFTNCNAXPBNG4WH3KTVZAJUOI6NAU24AFODJFJWNUSI7427PZUQ, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.902445740 (389h36m31.63371338s) [noise=true , address=104.36.82.50:4021 , piece_id=ZOS2CI2YD633X7WRFBJIQFV7POYYVZJYOQWKMI6VTAMIYOL7QQRQ, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.902682496 (389h36m31.633950126s) [noise=true , address=77.90.31.12:4602 , piece_id=A6HL4JBA45LNE5VGUEWH744P4BE3F3ICLKGYOVZUHQIUTOZRHYYA, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.903092175 (389h36m31.634359805s) [noise=true , address=77.90.31.11:4573 , piece_id=FYDAHKNQSBHIQ57UHOBK3CB25VGBYTTAAHTYZ6S7NSRVWPC6ZBLA, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.903531171 (389h36m31.634798801s) [noise=true , address=77.90.31.18:4837 , piece_id=CQS6HIM3MF5EFYPUJAA7HTT2T6ZZMA5HRKEH4ZKJ55WWWK3BUINA, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.905282884 (389h36m31.636550514s) [noise=true , address=104.36.82.23:4450 , piece_id=QWS6HRE3X5HJIUMBUZ3IJDVTFBMAKLSKTMHLXTUE6IPLQL4DRW7Q, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.905912268 (389h36m31.637179898s) [noise=true , address=77.90.31.10:4543 , piece_id=HXMQSUVXG767ZXYCCIEBSY3JZV4E4BGAJDZM3DNJ6YV4F4K2AN5A, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.906259050 (389h36m31.63752668s) [noise=true , address=104.36.82.13:4212 , piece_id=W675FSSDEQ4CT2YGNMM7YKH6RJ7PW6AYVLP65NOV7RQ6JBQJY3WA, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:50.906615860 (389h36m31.63788349s) [noise=true , address=104.36.82.5:4849 , piece_id=EIUSXXTHFYGNOGJ257ZAIMGIUIESCA3IXS3VVFVYJLCSTWHTBAPQ, seg_pos={0 0}, upload=405015]: Uploading piece...
Aug 24 23:02:51.015509768 (389h36m31.746777388s) [upload=405015]: Next returned nil segment
Aug 24 23:02:51.015524315 (389h36m31.746791935s) [upload=405015]: Waiting for error group managing segments...
Aug 24 23:02:51.035097083 (389h36m31.766364703s) [noise=true , address=104.36.82.2:4735 , piece_id=MN4EZMPF5HFPCDTUEXFDKARPLNCAMNOJC3H2YD6DJPBC32PL2KLQ, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.035691291 (389h36m31.766958921s) [noise=true , address=104.36.82.54:4191 , piece_id=HWFTNCNAXPBNG4WH3KTVZAJUOI6NAU24AFODJFJWNUSI7427PZUQ, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.036416944 (389h36m31.767684565s) [noise=true , address=104.36.82.12:4165 , piece_id=ITCMXDUVRIAAIZVN6YEYL76MS2ON3RUWBYAMP7SAM5NKX3X763MA, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.037012084 (389h36m31.768279703s) [noise=true , address=45.91.116.11:4146 , piece_id=EJZUCGI22T6SEQSXUGVKD5ZDDUVJ453RP3ALFBHMGFDD54UFMDKQ, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.037520299 (389h36m31.768787919s) [noise=true , address=104.36.82.44:4872 , piece_id=KRTR6K2BQRNN5VDLJ4T5WQWK7SBEOW3PPKSLELP2XKILD6W3SRBQ, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.041006423 (389h36m31.772274043s) [noise=true , address=45.91.116.9:4270 , piece_id=KXW2UXXUOP4BHBJGZHJDGVBNF3OPW4X4K5V22XCSDTVEPJSXDTNQ, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.041910602 (389h36m31.773178233s) [noise=true , address=104.36.82.23:4450 , piece_id=QWS6HRE3X5HJIUMBUZ3IJDVTFBMAKLSKTMHLXTUE6IPLQL4DRW7Q, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.042328619 (389h36m31.773596239s) [noise=true , address=77.90.31.14:4695 , piece_id=XULEHIAMLG2CGBGJC5MXB54KQQZKIK5VSYXUASGY3XVSHDVSHWXA, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.042800786 (389h36m31.774068406s) [noise=true , address=104.36.82.50:4021 , piece_id=ZOS2CI2YD633X7WRFBJIQFV7POYYVZJYOQWKMI6VTAMIYOL7QQRQ, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.043294805 (389h36m31.774562425s) [noise=true , address=104.36.82.60:4350 , piece_id=5QWUV5NTZGCMYFBO6SI2PMQDVNATSTK4IZLTEAKM4EJUNSWJGDXQ, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.043646386 (389h36m31.774913996s) [noise=true , address=104.36.82.13:4212 , piece_id=W675FSSDEQ4CT2YGNMM7YKH6RJ7PW6AYVLP65NOV7RQ6JBQJY3WA, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.061405234 (389h36m31.792672844s) [noise=true , address=77.90.31.12:4602 , piece_id=A6HL4JBA45LNE5VGUEWH744P4BE3F3ICLKGYOVZUHQIUTOZRHYYA, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.113251899 (389h36m31.844519518s) [noise=true , address=77.90.31.18:4837 , piece_id=CQS6HIM3MF5EFYPUJAA7HTT2T6ZZMA5HRKEH4ZKJ55WWWK3BUINA, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.131507130 (389h36m31.86277474s) [noise=true , address=104.36.82.5:4868 , piece_id=2GGSJMFHPDBF3HHTEWALIQFYUNDOC7HIZJDLXFKBME5JB6XFBJ2Q, seg_pos={0 0}, upload=405015]: Done uploading piece. err: <nil>
Aug 24 23:02:51.131522449 (389h36m31.862790069s) [seg_pos={0 0}, upload=405015]: Segment reached optimal threshold of 14 pieces.
Aug 24 23:02:51.131732905 (389h36m31.863000525s) [noise=true , address=77.90.31.10:4543 , piece_id=HXMQSUVXG767ZXYCCIEBSY3JZV4E4BGAJDZM3DNJ6YV4F4K2AN5A, seg_pos={0 0}, upload=405015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hFnVoQD97rytjEVNtPo8QumC37Eq1RM9MeXBP6Bap9rhK73bX): protocol: expected piece hash; context canceled; EOF
Aug 24 23:02:51.131740609 (389h36m31.863008219s) [noise=true , address=77.90.31.11:4573 , piece_id=FYDAHKNQSBHIQ57UHOBK3CB25VGBYTTAAHTYZ6S7NSRVWPC6ZBLA, seg_pos={0 0}, upload=405015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV): protocol: expected piece hash; context canceled; EOF
Aug 24 23:02:51.131823745 (389h36m31.863091365s) [noise=true , address=104.36.82.5:4849 , piece_id=EIUSXXTHFYGNOGJ257ZAIMGIUIESCA3IXS3VVFVYJLCSTWHTBAPQ, seg_pos={0 0}, upload=405015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2gSzVmNCEZcfVsFKibjXHs2jMr82D3SWQEykFQQ4uyhhnrj1): protocol: write tcp 5.161.89.252:18978->104.36.82.5:4849: use of closed network connection; write tcp 5.161.89.252:18978->104.36.82.5:4849: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18978->104.36.82.5:4849: use of closed network connection
Aug 24 23:02:51.131836509 (389h36m31.863104129s) [noise=true , address=77.90.31.16:4763 , piece_id=WSNMUZWNOT56P5FRKZWY7T2U6CEAHMGQZH7ESMX4GMDWLW4LZM5A, seg_pos={0 0}, upload=405015]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Bn4bKB4U5JidFqnXuPTncmNPGi72tgbL5YmYBRbbJ6ckqo35d): protocol: write tcp 5.161.89.252:33062->77.90.31.16:4763: use of closed network connection; write tcp 5.161.89.252:33062->77.90.31.16:4763: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33062->77.90.31.16:4763: use of closed network connection
Aug 24 23:02:51.131851517 (389h36m31.863119137s) [seg_pos={0 0}, upload=405015]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 24 23:02:51.131939413 (389h36m31.863207033s) [upload=405015]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 24 23:02:51.131945274 (389h36m31.863212894s) [upload=405015]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 24 23:02:51.265581878 (389h36m31.996849529s) [upload=405015]: Done uploading segments...
Aug 24 23:02:51.265618768 (389h36m31.996886418s) [upload=405015]: Upload finished. err: <nil>
Duration: 1.285895705s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|