Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 5.324679234s FAIL (2025-08-25 00:20:23 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 5.324703198s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.471266508s FAIL (2025-08-25 00:20:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 1.471290352s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 839.930707ms FAIL (2025-08-25 00:19:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 839.955665ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 2.921342806s FAIL (2025-08-25 00:19:37 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 2.92137132s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.941122805s FAIL (2025-08-25 00:19:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 1.941144487s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 1.251773079s FAIL (2025-08-25 00:18:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 1.251795811s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.584413632s FAIL (2025-08-25 00:18:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 1.584445783s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 3.543118478s FAIL (2025-08-25 00:18:25 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.543142854s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.042370134s FAIL (2025-08-25 00:18:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 2.042418425s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration: 21.541116871s FAIL (2025-08-25 00:17:46 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 21.541146769s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 512.295485ms FAIL (2025-08-25 00:17:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 512.320672ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 30.004831048s FAIL (2025-08-25 00:17:06 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.004853851s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.938101066s FAIL (2025-08-25 00:16:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 1.938127696s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 22.787345061s FAIL (2025-08-25 00:16:03 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 22.787367773s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 576.019186ms FAIL (2025-08-25 00:15:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 576.039474ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 21.454458868s FAIL (2025-08-25 00:15:40 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 21.454482601s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 3.209615556s FAIL (2025-08-25 00:15:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 3.209640132s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 3.250606705s FAIL (2025-08-25 00:14:54 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 3.250626954s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.006542637s FAIL (2025-08-25 00:14:41 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.006561543s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.114165116s FAIL (2025-08-25 00:14:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 2.114187026s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.002942279s FAIL (2025-08-25 00:14:03 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.002961685s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 399.959532ms FAIL (2025-08-25 00:13:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 399.985932ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.838805519s FAIL (2025-08-25 00:12:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 2.838831417s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.21851493s FAIL (2025-08-25 00:11:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 2.218535889s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 151.785133ms FAIL (2025-08-25 00:11:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 151.809748ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.090828515s FAIL (2025-08-25 00:11:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 2.090891862s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 1.525057212s FAIL (2025-08-25 00:11:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 1.525079996s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 495.17383ms FAIL (2025-08-25 00:10:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 495.198426ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 229.5357ms FAIL (2025-08-25 00:10:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 229.557781ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.154429213s FAIL (2025-08-25 00:09:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 2.154463108s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 203.457001ms FAIL (2025-08-25 00:09:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 203.479464ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 141.6153ms FAIL (2025-08-25 00:09:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 141.646688ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.279252975s FAIL (2025-08-25 00:09:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 2.279278994s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 154.843068ms FAIL (2025-08-25 00:08:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 154.863277ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 351.483491ms FAIL (2025-08-25 00:08:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 351.506343ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 619.465114ms FAIL (2025-08-25 00:08:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 619.48916ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 167.1723ms FAIL (2025-08-25 00:07:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 167.223626ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.830643768s FAIL (2025-08-25 00:06:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 1.830662504s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 267.968017ms FAIL (2025-08-25 00:06:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 267.984998ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 456.608232ms FAIL (2025-08-25 00:05:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 456.62838ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 515.21854ms FAIL (2025-08-25 00:05:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 515.24506ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 738.285317ms FAIL (2025-08-25 00:05:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 738.304083ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 526.96157ms FAIL (2025-08-25 00:05:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 526.991597ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 534.579406ms FAIL (2025-08-25 00:05:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 534.59776ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 437.765071ms FAIL (2025-08-25 00:04:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 437.787302ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.989757133s FAIL (2025-08-25 00:04:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 1.9898089s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 161.448234ms FAIL (2025-08-25 00:03:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 161.473722ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 356.356869ms FAIL (2025-08-25 00:03:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 356.381666ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 173.442814ms FAIL (2025-08-25 00:02:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 24 23:30:18.594372841 (390h3m59.325640462s) [upload=405496]: Starting upload Aug 24 23:30:18.594404520 (390h3m59.325672141s) [upload=405496]: Done starting upload Aug 24 23:30:18.594440217 (390h3m59.325707838s) [upload=405496]: Uploading segments... Aug 24 23:30:18.594464523 (390h3m59.325732143s) [upload=405496]: Got next segment. Inline: true Aug 24 23:30:18.594467609 (390h3m59.325735229s) [upload=405496]: Waiting for error group managing segments... Aug 24 23:30:18.594493157 (390h3m59.325760777s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:30:18.594496223 (390h3m59.325763842s) [upload=405496]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 24 23:30:18.594498597 (390h3m59.325766217s) [upload=405496]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:30:18.597136666 (390h3m59.328404296s) [upload=405496]: Done uploading segments... Aug 24 23:30:18.597146273 (390h3m59.328413894s) [upload=405496]: Upload finished. err: metaclient: Too Many Requests Duration:* 173.463573ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 569.215939ms FAIL (2025-08-25 00:02:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 24 23:47:36.044031496 (390h21m16.775299155s) [upload=405799]: Starting upload Aug 24 23:47:36.044110814 (390h21m16.775378464s) [upload=405799]: Done starting upload Aug 24 23:47:36.044169164 (390h21m16.775436804s) [upload=405799]: Uploading segments... Aug 24 23:47:36.044520775 (390h21m16.775788415s) [upload=405799]: Got next segment. Inline: false Aug 24 23:47:36.044585817 (390h21m16.775853467s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 24 23:47:36.044618609 (390h21m16.775886249s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 24 23:47:36.262169641 (390h21m16.993437291s) [seg_pos={0 0}, upload=405799]: Begin upload segment... Aug 24 23:47:36.262208184 (390h21m16.993475833s) [seg_pos={0 0}, upload=405799]: Done begin upload segment. Aug 24 23:47:36.262234262 (390h21m16.993501913s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262294445 (390h21m16.993562065s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262676013 (390h21m16.993943633s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262697854 (390h21m16.993965504s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.262910924 (390h21m16.994178545s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263194547 (390h21m16.994462167s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263215096 (390h21m16.994482746s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263412868 (390h21m16.994680488s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263837074 (390h21m16.995104694s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.263870857 (390h21m16.995138508s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264282883 (390h21m16.995550563s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264525919 (390h21m16.99579354s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.264731786 (390h21m16.995999517s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265183916 (390h21m16.996451567s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.265635224 (390h21m16.996902874s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266125626 (390h21m16.997393276s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266536007 (390h21m16.997803657s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.266959955 (390h21m16.998227604s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Uploading piece... Aug 24 23:47:36.403423859 (390h21m17.134691479s) [upload=405799]: Next returned nil segment Aug 24 23:47:36.403453535 (390h21m17.134721165s) [upload=405799]: Waiting for error group managing segments... Aug 24 23:47:36.415884317 (390h21m17.147151937s) [noise=true , address=104.36.82.54:4183 , piece_id=WZI2HLJ5OWWW3LLWRDHCVNMTKZ4PLL4M6NTOXZ6SLXQU5XSVL4GQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416310608 (390h21m17.147578248s) [noise=true , address=104.36.82.23:4480 , piece_id=SAMNBKVVAAKKXK7FKOA5ST4DDHGXM2AESZSNQOQ54QLTYVCEPSQA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416354239 (390h21m17.14762188s) [noise=true , address=104.36.82.55:4215 , piece_id=PLJSBIRF7FNKS5XHMNDQUQQHH7CA4IQ3PE6QCC2RQPWS2EQLECHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416686756 (390h21m17.147954375s) [noise=true , address=104.36.82.7:4920 , piece_id=UUBNDCIKNV2WMVHHGAYYJRT7JXESWYQWMDJL5B2IF72FZAV5AAZQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.416999533 (390h21m17.148267153s) [noise=true , address=104.36.82.34:4568 , piece_id=7DY6VVPZSBJBEGXR6Z5OQJBI4TJMH7SSXQW4UO5BXOZ636G6EZHA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417248912 (390h21m17.148516552s) [noise=true , address=104.36.82.23:4465 , piece_id=QTKGTCVWHXYGGP7GRQYW44N4NAKOT2NEYHIPWEAJ6FG46UQR6G7A, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417401759 (390h21m17.14866938s) [noise=true , address=104.36.82.4:4806 , piece_id=3WQW52SDUQC3GNUZJ3DYDBZAZ2MLKF4HCUFYCEHKJFBFZYZDEWLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.417789377 (390h21m17.149057018s) [noise=true , address=45.91.116.10:4084 , piece_id=HCQ77QKCXFTKK3PF5UT7G7EN7SBZIH27XL3BWA4H67XQCR3H2NTA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.419055928 (390h21m17.150323548s) [noise=true , address=104.36.82.19:4407 , piece_id=DHD5C3K5TTES5SPERZZNEVBLYUXRHJ4HKGYXT6XR4EQE7JFOPWGA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420059835 (390h21m17.151327474s) [noise=true , address=104.36.82.52:4094 , piece_id=LQIICXDLYJXOUJD3SXC3BGZXV5BO2AHHYL6XIJ7RWRDAWZ276BXA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420136368 (390h21m17.151403989s) [noise=true , address=104.36.82.22:4524 , piece_id=NVCZ4NCLMNQ2ADCOFBN3HOCFHJ5XNOPHEKSQ235EHCBRFYGSVJCQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.420681383 (390h21m17.151949023s) [noise=true , address=104.36.82.37:4658 , piece_id=675JCTDG5GSOHSL5DRLQUR2J4E7E2Z5N3BJNTK2IUFSKI4A3JCKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.424385805 (390h21m17.155653435s) [noise=true , address=45.91.116.7:4027 , piece_id=L43JY3KXRR5ITARZG2IAIFOPS2DT4REI4G7UQOPA4QPFYQ7KTBLQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430900039 (390h21m17.162167659s) [noise=true , address=104.36.82.44:4893 , piece_id=W6INOQ64FGOHFBUJYHVMIS5OJP6TQAFR4JY4Q2K4E2ILMNURLDKQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: <nil> Aug 24 23:47:36.430915237 (390h21m17.162182857s) [seg_pos={0 0}, upload=405799]: Segment reached optimal threshold of 14 pieces. Aug 24 23:47:36.431005767 (390h21m17.162273397s) [noise=true , address=77.90.31.16:4755 , piece_id=VI4Z7OWP6AHQWBPEWXZWYGVHFPEFSRJLBL2F6OGJQNEJVWOXVFHQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431165167 (390h21m17.162432817s) [noise=true , address=77.90.31.21:4909 , piece_id=26XCWQIIY2O3YIOAN3HTZ27OSKURNFLOVIXOE3JEOXWJUROMPBMQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431244946 (390h21m17.162512597s) [noise=true , address=104.36.82.5:4857 , piece_id=OIQMRWSYSUDYRRLX4OZYL3B2UHS77SFB444HEQXBM2O5DPWSNQZA, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1qjxNyfMA6ZjUurQZty2L8U5SUGo6wcLfCb3KVbmWn3ZaDXzQz): protocol: expected piece hash; context canceled; EOF Aug 24 23:47:36.431289349 (390h21m17.162556979s) [noise=true , address=104.36.82.60:4356 , piece_id=JJJM3FY7X7JF7XFQYJOR7PFWS5OJGBH2OZIBDCJ7ECBW2LARC4MQ, seg_pos={0 0}, upload=405799]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ErG54kzXSK5hXDTYZpL6X3dg26sqW2kdM6CQMLp3qMMHteir1): protocol: read tcp 5.161.89.252:21794->104.36.82.60:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 24 23:47:36.431339254 (390h21m17.162606884s) [seg_pos={0 0}, upload=405799]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 24 23:47:36.431389448 (390h21m17.162657078s) [upload=405799]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 24 23:47:36.431392855 (390h21m17.162660475s) [upload=405799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 24 23:47:36.759938233 (390h21m17.491205883s) [upload=405799]: Done uploading segments... Aug 24 23:47:36.759957870 (390h21m17.491225519s) [upload=405799]: Upload finished. err: <nil> Duration: 569.243651ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)