Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 949.615724ms FAIL (2025-09-19 04:07:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 949.635881ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 855.402932ms FAIL (2025-09-19 04:07:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 855.42262ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 468.191976ms FAIL (2025-09-19 04:06:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 468.211362ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 1.064817754s FAIL (2025-09-19 04:06:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.064833765s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 581.757877ms FAIL (2025-09-19 04:06:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 581.781672ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 729.671415ms FAIL (2025-09-19 04:05:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 729.690241ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 676.226646ms FAIL (2025-09-19 04:05:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 676.245742ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 467.684564ms FAIL (2025-09-19 04:05:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 467.712647ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 633.757219ms FAIL (2025-09-19 04:05:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 633.783549ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 483.584461ms FAIL (2025-09-19 04:04:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 483.608567ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 681.417675ms FAIL (2025-09-19 04:04:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 681.448453ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 922.611668ms FAIL (2025-09-19 04:04:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 922.631434ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 489.555758ms FAIL (2025-09-19 04:04:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 489.583ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 845.739757ms FAIL (2025-09-19 04:03:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 845.759364ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 489.130981ms FAIL (2025-09-19 04:03:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 489.153826ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 708.555942ms FAIL (2025-09-19 04:03:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 708.577673ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 752.109893ms FAIL (2025-09-19 04:03:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 752.123508ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 715.053757ms FAIL (2025-09-19 04:02:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 715.119971ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 709.315889ms FAIL (2025-09-19 04:02:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 709.341889ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 616.366594ms FAIL (2025-09-19 04:02:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 616.386371ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................XX................] duration: 445.092849ms FAIL (2025-09-19 04:02:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 445.111965ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 1.02793961s FAIL (2025-09-19 04:01:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.027960449s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 720.649697ms FAIL (2025-09-19 04:01:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 720.67301ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 958.180444ms FAIL (2025-09-19 04:01:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 958.202095ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 513.09034ms FAIL (2025-09-19 04:00:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 513.112362ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 732.963654ms FAIL (2025-09-19 04:00:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 732.999121ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 700.366984ms FAIL (2025-09-19 04:00:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 700.398173ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 654.216645ms FAIL (2025-09-19 04:00:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 654.24134ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................XX................] duration: 690.791445ms FAIL (2025-09-19 03:59:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 690.84136ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 604.983945ms FAIL (2025-09-19 03:59:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 605.006626ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 556.868614ms FAIL (2025-09-19 03:59:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 556.889643ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 449.888167ms FAIL (2025-09-19 03:58:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 449.947028ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 763.795197ms FAIL (2025-09-19 03:58:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 763.81333ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 385.349605ms FAIL (2025-09-19 03:58:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 385.374483ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 481.059152ms FAIL (2025-09-19 03:58:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 481.082777ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 401.643834ms FAIL (2025-09-19 03:57:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 401.664494ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 942.492576ms FAIL (2025-09-19 03:57:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 942.504037ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 396.01843ms FAIL (2025-09-19 03:57:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 396.037606ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 687.27906ms FAIL (2025-09-19 03:57:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 687.331719ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 850.272668ms FAIL (2025-09-19 03:57:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 850.30057ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 720.186151ms FAIL (2025-09-19 03:56:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 720.240584ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 492.96265ms FAIL (2025-09-19 03:56:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 492.982807ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 778.289006ms FAIL (2025-09-19 03:56:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 778.310565ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 1.272407445s FAIL (2025-09-19 03:55:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 1.272433684s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 870.90128ms FAIL (2025-09-19 03:55:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 870.960883ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 466.338457ms FAIL (2025-09-19 03:55:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 466.379384ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 441.861777ms FAIL (2025-09-19 03:55:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 441.883998ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 438.392095ms FAIL (2025-09-19 03:55:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 438.41087ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 837.601491ms FAIL (2025-09-19 03:54:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 837.63294ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 451.466688ms FAIL (2025-09-19 03:54:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 451.486967ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)