Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 447.687586ms FAIL (2025-09-19 04:20:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 447.713344ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 840.363737ms FAIL (2025-09-19 04:20:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 840.380249ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 541.305293ms FAIL (2025-09-19 04:19:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 541.325693ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 673.823588ms FAIL (2025-09-19 04:19:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 673.844767ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 889.825811ms FAIL (2025-09-19 04:19:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 889.849616ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 465.430861ms FAIL (2025-09-19 04:19:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 465.455087ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration: 515.643838ms FAIL (2025-09-19 04:18:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 515.672073ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 547.473768ms FAIL (2025-09-19 04:18:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 547.492713ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................XX....................................] duration: 459.543116ms FAIL (2025-09-19 04:18:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 459.570598ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 797.19484ms FAIL (2025-09-19 04:18:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 797.212182ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 936.270588ms FAIL (2025-09-19 04:17:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 936.293602ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................XX...................................] duration: 646.109743ms FAIL (2025-09-19 04:17:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 646.134089ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 682.588977ms FAIL (2025-09-19 04:17:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 682.607932ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 427.380502ms FAIL (2025-09-19 04:16:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 427.402773ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 778.82033ms FAIL (2025-09-19 04:16:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 778.837541ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................XX..................................] duration: 611.905191ms FAIL (2025-09-19 04:16:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 611.923615ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration: 589.813487ms FAIL (2025-09-19 04:16:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 589.960873ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 520.784849ms FAIL (2025-09-19 04:16:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 520.810578ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................XX.................................] duration: 512.114589ms FAIL (2025-09-19 04:16:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 512.140057ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................XX....................................] duration: 620.941008ms FAIL (2025-09-19 04:15:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 620.973751ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 559.977527ms FAIL (2025-09-19 04:15:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 560.003896ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................XX...................................] duration: 578.50846ms FAIL (2025-09-19 04:15:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 578.533858ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................XX................................] duration: 440.671302ms FAIL (2025-09-19 04:14:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 440.698904ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 404.999434ms FAIL (2025-09-19 04:14:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 405.025172ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................XX...............................] duration: 604.245718ms FAIL (2025-09-19 04:14:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 604.267689ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................XX..................................] duration: 603.806483ms FAIL (2025-09-19 04:14:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 603.823114ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 656.517521ms FAIL (2025-09-19 04:13:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 656.553106ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................XX..............................] duration: 451.394665ms FAIL (2025-09-19 04:13:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 451.418451ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................XX.................................] duration: 675.610782ms FAIL (2025-09-19 04:13:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 675.640728ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 550.770902ms FAIL (2025-09-19 04:13:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 550.789587ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................XX................................] duration: 628.853475ms FAIL (2025-09-19 04:12:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 628.875135ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 568.787829ms FAIL (2025-09-19 04:12:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 568.807546ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 713.139654ms FAIL (2025-09-19 04:12:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 713.158809ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 484.411455ms FAIL (2025-09-19 04:11:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 484.43604ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........................XX...............................] duration: 618.519603ms FAIL (2025-09-19 04:11:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 618.538739ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 435.267973ms FAIL (2025-09-19 04:11:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 435.292488ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 594.14873ms FAIL (2025-09-19 04:11:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 594.169359ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............................XX..............................] duration: 825.943287ms FAIL (2025-09-19 04:10:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 825.959396ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 541.591766ms FAIL (2025-09-19 04:10:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 541.610843ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 614.15284ms FAIL (2025-09-19 04:10:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 614.175112ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 795.996529ms FAIL (2025-09-19 04:09:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 796.015455ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 626.615637ms FAIL (2025-09-19 04:09:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 626.645934ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 471.188359ms FAIL (2025-09-19 04:09:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 471.207384ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 723.682657ms FAIL (2025-09-19 04:09:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 723.706803ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 724.335052ms FAIL (2025-09-19 04:09:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 724.366711ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 681.915369ms FAIL (2025-09-19 04:08:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 681.944234ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 535.948644ms FAIL (2025-09-19 04:08:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 535.988932ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 710.561044ms FAIL (2025-09-19 04:08:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 710.584328ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 1.625683626s FAIL (2025-09-19 04:07:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.62569691s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 973.982067ms FAIL (2025-09-19 04:07:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 974.009008ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)