Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.301823572s FAIL (2025-08-22 08:59:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.30184259s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 946.43908ms FAIL (2025-08-22 08:58:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 946.462945ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 419.858696ms FAIL (2025-08-22 08:58:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 419.890966ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X......................................X....................] duration: 141.671297ms FAIL (2025-08-22 08:58:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 141.697166ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 353.866282ms FAIL (2025-08-22 08:58:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 353.894555ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.246937381s FAIL (2025-08-22 08:57:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.246962839s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X......................................X...................] duration: 195.349087ms FAIL (2025-08-22 08:57:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 195.36697ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.635392404s FAIL (2025-08-22 08:57:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.635447206s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X......................................X..................] duration: 134.489305ms FAIL (2025-08-22 08:57:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 134.523889ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 355.946918ms FAIL (2025-08-22 08:56:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 355.971644ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.76147054s FAIL (2025-08-22 08:56:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.761493432s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X......................................X.................] duration: 140.90913ms FAIL (2025-08-22 08:56:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 140.928707ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.102086551s FAIL (2025-08-22 08:55:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.102104355s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X......................................X................] duration: 148.173124ms FAIL (2025-08-22 08:55:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 148.199574ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.20851034s FAIL (2025-08-22 08:54:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.208535005s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X......................................X...............] duration: 176.74969ms FAIL (2025-08-22 08:54:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 176.768074ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 940.446141ms FAIL (2025-08-22 08:54:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 940.47222ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X......................................X..............] duration: 135.815048ms FAIL (2025-08-22 08:54:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 135.837079ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 513.851507ms FAIL (2025-08-22 08:53:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 513.868569ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X......................................X.............] duration: 155.254046ms FAIL (2025-08-22 08:53:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 155.27219ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.645660868s FAIL (2025-08-22 08:53:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.645681317s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X......................................X............] duration: 170.595352ms FAIL (2025-08-22 08:52:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 170.620098ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.478015642s FAIL (2025-08-22 08:52:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.47804217s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X......................................X...........] duration: 116.687814ms FAIL (2025-08-22 08:51:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 116.708792ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X......................................X..........] duration: 134.702412ms FAIL (2025-08-22 08:51:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 134.740114ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 410.697072ms FAIL (2025-08-22 08:51:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 410.714435ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 584.716995ms FAIL (2025-08-22 08:50:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 584.737554ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X......................................X.........] duration: 126.585739ms FAIL (2025-08-22 08:50:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 126.609874ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.902774894s FAIL (2025-08-22 08:49:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.902840077s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X......................................X........] duration: 142.294628ms FAIL (2025-08-22 08:49:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 142.334512ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.805920561s FAIL (2025-08-22 08:49:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 2.805939367s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X......................................X.......] duration: 150.728126ms FAIL (2025-08-22 08:48:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 150.751589ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.197846795s FAIL (2025-08-22 08:48:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.197873006s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X......................................X......] duration: 178.271684ms FAIL (2025-08-22 08:48:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 178.29605ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X......................................X.....] duration: 1.225121334s FAIL (2025-08-22 08:47:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.225152324s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 764.939624ms FAIL (2025-08-22 08:47:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 764.999336ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.623829477s FAIL (2025-08-22 08:46:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.623856979s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X......................................X....] duration: 412.234297ms FAIL (2025-08-22 08:46:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 412.2562ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.553747934s FAIL (2025-08-22 08:46:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.553770927s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X......................................X...] duration: 138.533836ms FAIL (2025-08-22 08:45:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 138.553334ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X......................................X..] duration: 388.934087ms FAIL (2025-08-22 08:45:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 388.952481ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.474274638s FAIL (2025-08-22 08:44:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.474300416s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.273943489s FAIL (2025-08-22 08:44:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.273963758s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X......................................X.] duration: 152.541762ms FAIL (2025-08-22 08:43:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 152.574153ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 418.319264ms FAIL (2025-08-22 08:43:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 418.34358ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X......................................X] duration: 22.294067ms FAIL (2025-08-22 08:43:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:43:11.594667364 (327h16m52.325934994s) [upload=340299]: Starting upload Aug 22 08:43:11.594707228 (327h16m52.325974859s) [upload=340299]: Done starting upload Aug 22 08:43:11.594752024 (327h16m52.326019654s) [upload=340299]: Uploading segments... Aug 22 08:43:11.594784374 (327h16m52.326052024s) [upload=340299]: Got next segment. Inline: true Aug 22 08:43:11.594790095 (327h16m52.326057735s) [upload=340299]: Waiting for error group managing segments... Aug 22 08:43:11.594884222 (327h16m52.326151842s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:43:11.594889763 (327h16m52.326157393s) [upload=340299]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:43:11.594892117 (327h16m52.326159737s) [upload=340299]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:43:11.603073061 (327h16m52.334340691s) [upload=340299]: Done uploading segments... Aug 22 08:43:11.603081296 (327h16m52.334348926s) [upload=340299]: Upload finished. err: metaclient: Too Many Requests Duration:* 22.309375ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.226032781s FAIL (2025-08-22 08:42:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.22606409s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 528.51261ms FAIL (2025-08-22 08:42:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:12:42.097850309 (326h46m22.829117929s) [upload=339769]: Starting upload Aug 22 08:12:42.097905312 (326h46m22.829172932s) [upload=339769]: Done starting upload Aug 22 08:12:42.097976436 (326h46m22.829244056s) [upload=339769]: Uploading segments... Aug 22 08:12:42.098010901 (326h46m22.829278521s) [upload=339769]: Got next segment. Inline: true Aug 22 08:12:42.098014358 (326h46m22.829281977s) [upload=339769]: Waiting for error group managing segments... Aug 22 08:12:42.098056306 (326h46m22.829323926s) [upload=339769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:12:42.098061095 (326h46m22.829328715s) [upload=339769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:12:42.098064582 (326h46m22.829332202s) [upload=339769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:12:42.119158030 (326h46m22.850425651s) [upload=339769]: Done uploading segments... Aug 22 08:12:42.119172568 (326h46m22.850440208s) [upload=339769]: Upload finished. err: metaclient: Too Many Requests Duration:* 528.540633ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 346.645804ms FAIL (2025-08-22 08:42:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 08:12:42.097850309 (326h46m22.829117929s) [upload=339769]: Starting upload Aug 22 08:12:42.097905312 (326h46m22.829172932s) [upload=339769]: Done starting upload Aug 22 08:12:42.097976436 (326h46m22.829244056s) [upload=339769]: Uploading segments... Aug 22 08:12:42.098010901 (326h46m22.829278521s) [upload=339769]: Got next segment. Inline: true Aug 22 08:12:42.098014358 (326h46m22.829281977s) [upload=339769]: Waiting for error group managing segments... Aug 22 08:12:42.098056306 (326h46m22.829323926s) [upload=339769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:12:42.098061095 (326h46m22.829328715s) [upload=339769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 08:12:42.098064582 (326h46m22.829332202s) [upload=339769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:12:42.119158030 (326h46m22.850425651s) [upload=339769]: Done uploading segments... Aug 22 08:12:42.119172568 (326h46m22.850440208s) [upload=339769]: Upload finished. err: metaclient: Too Many Requests Duration:* 346.663077ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.835637542s FAIL (2025-08-22 08:41:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 08:37:22.268867578 (327h11m3.000135198s) [upload=340201]: Starting upload Aug 22 08:37:22.268930135 (327h11m3.000197756s) [upload=340201]: Done starting upload Aug 22 08:37:22.269042958 (327h11m3.000310578s) [upload=340201]: Uploading segments... Aug 22 08:37:22.269157494 (327h11m3.000425124s) [upload=340201]: Got next segment. Inline: false Aug 22 08:37:22.269193291 (327h11m3.000460911s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 08:37:22.269197559 (327h11m3.000465189s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 08:37:22.303101406 (327h11m3.034369027s) [seg_pos={0 0}, upload=340201]: Begin upload segment... Aug 22 08:37:22.303157653 (327h11m3.034425273s) [seg_pos={0 0}, upload=340201]: Done begin upload segment. Aug 22 08:37:22.303187549 (327h11m3.034455169s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303232794 (327h11m3.034500424s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303568446 (327h11m3.034836067s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303581732 (327h11m3.034849341s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303794583 (327h11m3.035062203s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.303892486 (327h11m3.035160106s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304039603 (327h11m3.035307233s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304225293 (327h11m3.035492943s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304298882 (327h11m3.035566512s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304512164 (327h11m3.035779783s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304530758 (327h11m3.035798389s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304741906 (327h11m3.036009536s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304798903 (327h11m3.036066523s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.304961650 (327h11m3.03622928s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305092485 (327h11m3.036360106s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305219575 (327h11m3.036487205s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305405045 (327h11m3.036672665s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.305877825 (327h11m3.037145445s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Uploading piece... Aug 22 08:37:22.389729130 (327h11m3.12099676s) [upload=340201]: Next returned nil segment Aug 22 08:37:22.389741494 (327h11m3.121009124s) [upload=340201]: Waiting for error group managing segments... Aug 22 08:37:22.399765478 (327h11m3.131033097s) [noise=true , address=45.91.116.12:4236 , piece_id=2MQAPWQZUZDBIW7PBRBPF6VZMFYJJPVOMVUSGLDZ4LAHF4KN5JCA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.399850528 (327h11m3.131118158s) [noise=true , address=45.91.116.10:4092 , piece_id=65AV6AHFMSWWEYO5GAYVODOFHTCHVYADBFRLO6643JQV26HN2IJA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401281792 (327h11m3.132549422s) [noise=true , address=79.127.219.51:4214 , piece_id=Y6N6BG67GIPUMTDPJB3OHZQBC7YCNGPJITQD6QGXTWIIB3WNZB3Q, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401317490 (327h11m3.132585111s) [noise=true , address=77.90.31.17:4796 , piece_id=CKOQ32KTZMTMZHTTJXGN5OIJGQG5JCE2UEPALCZT3EDCIC5GH4DQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.401706463 (327h11m3.132974083s) [noise=true , address=77.90.31.10:4541 , piece_id=GNSKHENZAW6QKQWE4KETI2NH3ZL4R5DPKH667EGFBFYKEWBPONDA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403418295 (327h11m3.134685925s) [noise=true , address=77.90.31.12:4613 , piece_id=MMNTDZT45X2QTBO57PQK3CMX4LP5Q7ZGGRH2KVEXTIM4K7IJT3NQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.403741033 (327h11m3.135008654s) [noise=true , address=104.36.82.5:4860 , piece_id=HMD2U6DL5DWSDJV2XSSAFG33M2JHP2UEJMOMJDKRSHQIJYW6YKPQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.404779268 (327h11m3.136046898s) [noise=true , address=104.36.82.23:4477 , piece_id=UFZ2SZ32RXEGJQKB3LYT7CSCS432EHKN43FOBBI7A5CGFDZD7ORQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.407529927 (327h11m3.138797548s) [noise=true , address=104.36.82.16:4306 , piece_id=CCAGPTRL5HYY244CSEB3MUJ4ANV3IWL7ZBAIIKKWTJ76VNMLM2AQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.409779273 (327h11m3.141046903s) [noise=true , address=104.36.82.50:4014 , piece_id=YDM3DLCS7NLTRF255VQQ3QLLO2M4CZ7YUMMX4E75XCNTPBPRXUVQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.412741050 (327h11m3.14400868s) [noise=true , address=45.91.116.5:4314 , piece_id=YAQGSTJV5TNSOACTQRHYLGKS5NEOWIIP3JOZDW7OENDZ6YQWNKTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.415057312 (327h11m3.146324942s) [noise=true , address=77.90.31.18:4831 , piece_id=IWKJHOIQUQJXOMWFXTSYDWGSUWXT5NP3HEH727TINYNPUIXPMHAQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.422430435 (327h11m3.153698054s) [noise=true , address=77.90.31.21:4904 , piece_id=S4KRLTVRUX7CJ22AWRGY2ZEXR6VNGSNRHBDNT4NLB4S6LP4FE6XQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.423985522 (327h11m3.155253142s) [noise=true , address=45.91.116.6:4007 , piece_id=MQTOKYWXGFUX5NRLEYXQ4FXBP4O4IGK2AAI5NCFX4WQXYXIYYSYA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: <nil> Aug 22 08:37:22.424009196 (327h11m3.155276826s) [seg_pos={0 0}, upload=340201]: Segment reached optimal threshold of 14 pieces. Aug 22 08:37:22.424114575 (327h11m3.155382205s) [noise=true , address=104.36.82.60:4342 , piece_id=5IMKCALGT225EGFRKRIWP3DDE3MRND3M3WVKSUYFKE5XAZ3OVFFA, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424241605 (327h11m3.155509224s) [noise=true , address=77.90.31.11:4571 , piece_id=YSG7NEQBN2YTV5PDTO6N47LCCJW3XGGTUYFYV24YPZANAA6F3DTQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy): protocol: expected piece hash; context canceled; EOF Aug 22 08:37:22.424315344 (327h11m3.155582974s) [noise=true , address=79.127.201.215:4356 , piece_id=2TORQV3ZGE323SSBT4UTVLCDNF76SNN5WESARV2X6E2AF674JBOQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vCjcquqBhLnXgnGVd5D3j7x8LBa7RrHngfwm2EA3eRJ2Mb35o): protocol: read tcp 5.161.89.252:53790->79.127.201.215:4356: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 22 08:37:22.424347645 (327h11m3.155615275s) [noise=true , address=79.127.220.97:4390 , piece_id=77S7C6AUZTU5QKJXFXOGCRFO4XQ65WEK2XWRIC66LVRP4OFXXVRQ, seg_pos={0 0}, upload=340201]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hzfYghA4c4uCQm4dYued8NriH4rYfmYp3mpTMS5JuXYwVbGSm): protocol: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16988->79.127.220.97:4390: use of closed network connection Aug 22 08:37:22.424368253 (327h11m3.155635873s) [seg_pos={0 0}, upload=340201]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 08:37:22.424416754 (327h11m3.155684384s) [upload=340201]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 08:37:22.424420120 (327h11m3.15568774s) [upload=340201]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 08:37:22.748349253 (327h11m3.479616904s) [upload=340201]: Done uploading segments... Aug 22 08:37:22.748368569 (327h11m3.47963622s) [upload=340201]: Upload finished. err: <nil> Duration: 1.835653282s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)