Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 507.935708ms FAIL (2025-09-19 03:54:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 507.959213ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 869.061648ms FAIL (2025-09-19 03:53:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 869.07879ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 516.725214ms FAIL (2025-09-19 03:53:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 516.747385ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 881.230332ms FAIL (2025-09-19 03:53:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 881.252574ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 704.00218ms FAIL (2025-09-19 03:53:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 704.024804ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 425.66059ms FAIL (2025-09-19 03:52:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 425.682211ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 678.579173ms FAIL (2025-09-19 03:52:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 678.598771ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 441.900081ms FAIL (2025-09-19 03:52:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 441.935988ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration: 903.605298ms FAIL (2025-09-19 03:52:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 903.622362ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration: 448.318281ms FAIL (2025-09-19 03:51:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 448.34937ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 405.863994ms FAIL (2025-09-19 03:51:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 405.886545ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 1.474836897s FAIL (2025-09-19 03:50:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.474855552s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 497.549227ms FAIL (2025-09-19 03:50:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 497.574595ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 759.664575ms FAIL (2025-09-19 03:50:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 759.69909ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 770.757803ms FAIL (2025-09-19 03:50:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 770.780285ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 509.750875ms FAIL (2025-09-19 03:49:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 509.780189ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 666.852841ms FAIL (2025-09-19 03:49:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 666.876986ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 541.917337ms FAIL (2025-09-19 03:49:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 541.95647ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 978.605384ms FAIL (2025-09-19 03:49:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 978.62486ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 715.77317ms FAIL (2025-09-19 03:48:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 715.793688ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 489.961106ms FAIL (2025-09-19 03:48:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 489.990152ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 972.233215ms FAIL (2025-09-19 03:48:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 972.485238ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 720.428406ms FAIL (2025-09-19 03:48:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 720.448072ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.000675913s FAIL (2025-09-19 03:48:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000691693s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 48.164937752s FAIL (2025-09-19 03:48:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 48.164955205s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.019046393s FAIL (2025-09-19 03:48:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Sep 19 03:47:30.844356630 (493h39m6.197141758s) [upload=434613]: Starting upload Sep 19 03:47:30.844438433 (493h39m6.197223571s) [upload=434613]: Done starting upload Sep 19 03:47:30.844486904 (493h39m6.197272012s) [upload=434613]: Uploading segments... Sep 19 03:47:30.844846129 (493h39m6.197631237s) [upload=434613]: Got next segment. Inline: false Sep 19 03:47:30.844877758 (493h39m6.197662866s) [upload=434613]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:47:30.844881926 (493h39m6.197667024s) [upload=434613]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:47:30.864926491 (493h39m6.217711599s) [seg_pos={0 0}, upload=434613]: Begin upload segment... Sep 19 03:47:30.864951006 (493h39m6.217736114s) [seg_pos={0 0}, upload=434613]: Done begin upload segment. Sep 19 03:47:30.864971575 (493h39m6.217756684s) [noise=true , address=77.90.31.15:4698 , piece_id=TIZJAO7R6PRWR5XVB3NKY3NJLZWHWDT7G5QDAFUX66YKUSUPYFDQ, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.864992334 (493h39m6.217777462s) [noise=true , address=145.79.227.11:4730 , piece_id=HWYZPBTUNROGLOON3JWRBCPHGGFFFAYDUU2NAOBFWKSY6LGC3PMQ, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.865276487 (493h39m6.218061585s) [noise=true , address=145.79.227.16:4910 , piece_id=SZIEKPLAFTAXFZJNGZNYR7UPMVMQ4YXFB7E2EB2ZXQI7GNQE7TOA, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.865503243 (493h39m6.218288351s) [noise=true , address=145.79.227.15:4875 , piece_id=5PZQIF6F6UWS3HOJU4DY2ZDHKOEDCM3BFKKAJKR64GPUADDBRTXQ, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.865715331 (493h39m6.218500439s) [noise=true , address=45.91.116.5:4297 , piece_id=HOOQ2WPKFK5E24QXPYNRMZFNYTIKXGHDIFFOF72MYLDM6RLMYL6A, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.865800911 (493h39m6.21858604s) [noise=true , address=45.91.116.8:4048 , piece_id=CXX6FQDENIN6QGGGGJTAG6GASQQELAHWEVUOZP6K5YV6XFWOJUSA, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.865927339 (493h39m6.218712437s) [noise=true , address=77.90.31.19:4843 , piece_id=4CDQBCT3TUYGLNJOQAPEGIDSUJNUJUIL6NC5B7IYFFER7FKZUMBQ, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.866147832 (493h39m6.21893294s) [noise=true , address=45.91.116.14:4191 , piece_id=36LOOF6HC4BMPX74WCZ66AXMFDA5R6Y3RJP5INJEL3TRWUMQUAEA, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.866362356 (493h39m6.219147494s) [noise=true , address=145.79.227.14:4838 , piece_id=DDSBK6WYKOUXUSO4RAPLI2NHJ6QF7EGGSEHZZWGODGES6DPNCMFA, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.867421493 (493h39m6.220206601s) [noise=true , address=45.91.116.10:4083 , piece_id=OMJZNLVDLLYGQQJYOLLMHQM6HEUVEXL4YYOVXKWDQWMYKCAJR5UQ, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.867736494 (493h39m6.220521602s) [noise=true , address=45.91.116.9:4262 , piece_id=HNQLDS3DYZVANXICTQOH6TFUKT767UCIJ3ZXONBZLJG7VZVHEW5A, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.868020938 (493h39m6.220806046s) [noise=true , address=45.91.116.13:4154 , piece_id=IVBXXSS5CR2P5TJRB5223OWXFU3OHFVJ32TWK2GD5VH47C3BKBOQ, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.868598822 (493h39m6.22138392s) [noise=true , address=145.79.227.2:4115 , piece_id=G3CGNJOQN2FMWYXUPZ43337G2SAQ7AEQXQQ2MXGHBDEPQD4NEGKQ, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.869757015 (493h39m6.222542123s) [noise=true , address=45.91.116.12:4225 , piece_id=7HRAUVWTMVOE57AFWURWI22RMUSE6ERBDEAKN6YKYNZ2NX3TQRKA, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.870052851 (493h39m6.222837959s) [noise=true , address=45.91.116.6:4973 , piece_id=QFCEKEHFAPF6CPDOAF45THA4I7X4LWFC2WCH427XTUUIAN7G3DFA, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.870525227 (493h39m6.223310325s) [noise=true , address=45.91.116.6:4974 , piece_id=YE4TVPYSWMCRTNIZSF3LNRLKSTGHDBOX2HNTW5KAQY3EOZ6HCDKQ, seg_pos={0 0}, upload=434613]: Uploading piece... Sep 19 03:47:30.965653673 (493h39m6.318438781s) [upload=434613]: Next returned nil segment Sep 19 03:47:30.965664623 (493h39m6.318449731s) [upload=434613]: Waiting for error group managing segments... Sep 19 03:47:30.974653842 (493h39m6.32743895s) [noise=true , address=45.91.116.13:4154 , piece_id=IVBXXSS5CR2P5TJRB5223OWXFU3OHFVJ32TWK2GD5VH47C3BKBOQ, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.975113805 (493h39m6.327898913s) [noise=true , address=45.91.116.14:4191 , piece_id=36LOOF6HC4BMPX74WCZ66AXMFDA5R6Y3RJP5INJEL3TRWUMQUAEA, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.975212490 (493h39m6.327997618s) [noise=true , address=45.91.116.6:4973 , piece_id=QFCEKEHFAPF6CPDOAF45THA4I7X4LWFC2WCH427XTUUIAN7G3DFA, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.975855186 (493h39m6.328640294s) [noise=true , address=45.91.116.5:4297 , piece_id=HOOQ2WPKFK5E24QXPYNRMZFNYTIKXGHDIFFOF72MYLDM6RLMYL6A, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.976014766 (493h39m6.328799893s) [noise=true , address=77.90.31.15:4698 , piece_id=TIZJAO7R6PRWR5XVB3NKY3NJLZWHWDT7G5QDAFUX66YKUSUPYFDQ, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.976412001 (493h39m6.32919711s) [noise=true , address=45.91.116.10:4083 , piece_id=OMJZNLVDLLYGQQJYOLLMHQM6HEUVEXL4YYOVXKWDQWMYKCAJR5UQ, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.977745404 (493h39m6.330530512s) [noise=true , address=45.91.116.12:4225 , piece_id=7HRAUVWTMVOE57AFWURWI22RMUSE6ERBDEAKN6YKYNZ2NX3TQRKA, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.978259598 (493h39m6.331044737s) [noise=true , address=45.91.116.9:4262 , piece_id=HNQLDS3DYZVANXICTQOH6TFUKT767UCIJ3ZXONBZLJG7VZVHEW5A, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.978313550 (493h39m6.331098648s) [noise=true , address=45.91.116.8:4048 , piece_id=CXX6FQDENIN6QGGGGJTAG6GASQQELAHWEVUOZP6K5YV6XFWOJUSA, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.978731514 (493h39m6.331516612s) [noise=true , address=45.91.116.6:4974 , piece_id=YE4TVPYSWMCRTNIZSF3LNRLKSTGHDBOX2HNTW5KAQY3EOZ6HCDKQ, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:47:30.978882618 (493h39m6.331667745s) [noise=true , address=77.90.31.19:4843 , piece_id=4CDQBCT3TUYGLNJOQAPEGIDSUJNUJUIL6NC5B7IYFFER7FKZUMBQ, seg_pos={0 0}, upload=434613]: Done uploading piece. err: <nil> Sep 19 03:48:00.826138894 (493h39m36.178923993s) [noise=true , address=145.79.227.11:4730 , piece_id=HWYZPBTUNROGLOON3JWRBCPHGGFFFAYDUU2NAOBFWKSY6LGC3PMQ, seg_pos={0 0}, upload=434613]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: rpc: dial tcp 145.79.227.11:4730: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:00.826177246 (493h39m36.178962354s) [noise=true , address=145.79.227.15:4875 , piece_id=5PZQIF6F6UWS3HOJU4DY2ZDHKOEDCM3BFKKAJKR64GPUADDBRTXQ, seg_pos={0 0}, upload=434613]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:00.826265833 (493h39m36.179050931s) [noise=true , address=145.79.227.2:4115 , piece_id=G3CGNJOQN2FMWYXUPZ43337G2SAQ7AEQXQQ2MXGHBDEPQD4NEGKQ, seg_pos={0 0}, upload=434613]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: rpc: dial tcp 145.79.227.2:4115: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:00.826311469 (493h39m36.179096577s) [noise=true , address=145.79.227.16:4910 , piece_id=SZIEKPLAFTAXFZJNGZNYR7UPMVMQ4YXFB7E2EB2ZXQI7GNQE7TOA, seg_pos={0 0}, upload=434613]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:145.79.227.16:4910): protocol: rpc: dial tcp 145.79.227.16:4910: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:00.826383904 (493h39m36.179169012s) [noise=true , address=145.79.227.14:4838 , piece_id=DDSBK6WYKOUXUSO4RAPLI2NHJ6QF7EGGSEHZZWGODGES6DPNCMFA, seg_pos={0 0}, upload=434613]: Done uploading piece. err: ecclient: upload failed (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL, address:145.79.227.14:4838): protocol: rpc: dial tcp 145.79.227.14:4838: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:00.826415563 (493h39m36.179200662s) [seg_pos={0 0}, upload=434613]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Sep 19 03:48:00.843276524 (493h39m36.196061632s) [upload=434613]: Done uploading segments... Sep 19 03:48:00.843299127 (493h39m36.196084235s) [upload=434613]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.019063475s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.022135796s FAIL (2025-09-19 03:47:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 1m0.022156505s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.000717846s FAIL (2025-09-19 03:47:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000754826s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 551.681107ms FAIL (2025-09-18 22:38:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 551.706285ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 496.214309ms FAIL (2025-09-18 22:37:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 496.230972ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 563.117431ms FAIL (2025-09-18 22:37:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 563.139924ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 437.192738ms FAIL (2025-09-18 22:36:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 437.220131ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 659.457697ms FAIL (2025-09-18 22:35:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 659.482112ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 331.997527ms FAIL (2025-09-18 22:35:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 21:51:18.726734295 (487h42m54.079519424s) [upload=429383]: Starting upload Sep 18 21:51:18.726861354 (487h42m54.079646542s) [upload=429383]: Done starting upload Sep 18 21:51:18.726936915 (487h42m54.079722053s) [upload=429383]: Uploading segments... Sep 18 21:51:18.726991948 (487h42m54.079777077s) [upload=429383]: Got next segment. Inline: true Sep 18 21:51:18.726998431 (487h42m54.079783569s) [upload=429383]: Waiting for error group managing segments... Sep 18 21:51:18.727045299 (487h42m54.079830436s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:18.727051290 (487h42m54.079836418s) [upload=429383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 18 21:51:18.727054927 (487h42m54.079840054s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 21:51:48.713342311 (487h43m24.066127419s) [upload=429383]: Done uploading segments... Sep 18 21:51:48.713357910 (487h43m24.066143008s) [upload=429383]: Upload finished. err: metaclient: context deadline exceeded Duration:* 332.017043ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 463.271654ms FAIL (2025-09-18 22:34:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 463.298925ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 290.306002ms FAIL (2025-09-18 22:34:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 21:51:18.726734295 (487h42m54.079519424s) [upload=429383]: Starting upload Sep 18 21:51:18.726861354 (487h42m54.079646542s) [upload=429383]: Done starting upload Sep 18 21:51:18.726936915 (487h42m54.079722053s) [upload=429383]: Uploading segments... Sep 18 21:51:18.726991948 (487h42m54.079777077s) [upload=429383]: Got next segment. Inline: true Sep 18 21:51:18.726998431 (487h42m54.079783569s) [upload=429383]: Waiting for error group managing segments... Sep 18 21:51:18.727045299 (487h42m54.079830436s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:18.727051290 (487h42m54.079836418s) [upload=429383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 18 21:51:18.727054927 (487h42m54.079840054s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 21:51:48.713342311 (487h43m24.066127419s) [upload=429383]: Done uploading segments... Sep 18 21:51:48.713357910 (487h43m24.066143008s) [upload=429383]: Upload finished. err: metaclient: context deadline exceeded Duration:* 290.329216ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 581.760407ms FAIL (2025-09-18 22:34:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 581.784192ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 618.217135ms FAIL (2025-09-18 22:33:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 618.239268ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 405.471598ms FAIL (2025-09-18 22:33:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 21:51:18.726734295 (487h42m54.079519424s) [upload=429383]: Starting upload Sep 18 21:51:18.726861354 (487h42m54.079646542s) [upload=429383]: Done starting upload Sep 18 21:51:18.726936915 (487h42m54.079722053s) [upload=429383]: Uploading segments... Sep 18 21:51:18.726991948 (487h42m54.079777077s) [upload=429383]: Got next segment. Inline: true Sep 18 21:51:18.726998431 (487h42m54.079783569s) [upload=429383]: Waiting for error group managing segments... Sep 18 21:51:18.727045299 (487h42m54.079830436s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:18.727051290 (487h42m54.079836418s) [upload=429383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 18 21:51:18.727054927 (487h42m54.079840054s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 21:51:48.713342311 (487h43m24.066127419s) [upload=429383]: Done uploading segments... Sep 18 21:51:48.713357910 (487h43m24.066143008s) [upload=429383]: Upload finished. err: metaclient: context deadline exceeded Duration:* 405.492318ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 246.547376ms FAIL (2025-09-18 22:33:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 246.569668ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 263.706811ms FAIL (2025-09-18 22:33:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 21:51:18.726734295 (487h42m54.079519424s) [upload=429383]: Starting upload Sep 18 21:51:18.726861354 (487h42m54.079646542s) [upload=429383]: Done starting upload Sep 18 21:51:18.726936915 (487h42m54.079722053s) [upload=429383]: Uploading segments... Sep 18 21:51:18.726991948 (487h42m54.079777077s) [upload=429383]: Got next segment. Inline: true Sep 18 21:51:18.726998431 (487h42m54.079783569s) [upload=429383]: Waiting for error group managing segments... Sep 18 21:51:18.727045299 (487h42m54.079830436s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:18.727051290 (487h42m54.079836418s) [upload=429383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 18 21:51:18.727054927 (487h42m54.079840054s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 21:51:48.713342311 (487h43m24.066127419s) [upload=429383]: Done uploading segments... Sep 18 21:51:48.713357910 (487h43m24.066143008s) [upload=429383]: Upload finished. err: metaclient: context deadline exceeded Duration:* 263.727208ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 543.853435ms FAIL (2025-09-18 22:32:55 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 543.872632ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 650.99201ms FAIL (2025-09-18 22:32:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 651.019111ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 211.88765ms FAIL (2025-09-18 22:32:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 21:51:18.726734295 (487h42m54.079519424s) [upload=429383]: Starting upload Sep 18 21:51:18.726861354 (487h42m54.079646542s) [upload=429383]: Done starting upload Sep 18 21:51:18.726936915 (487h42m54.079722053s) [upload=429383]: Uploading segments... Sep 18 21:51:18.726991948 (487h42m54.079777077s) [upload=429383]: Got next segment. Inline: true Sep 18 21:51:18.726998431 (487h42m54.079783569s) [upload=429383]: Waiting for error group managing segments... Sep 18 21:51:18.727045299 (487h42m54.079830436s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:18.727051290 (487h42m54.079836418s) [upload=429383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 18 21:51:18.727054927 (487h42m54.079840054s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 21:51:48.713342311 (487h43m24.066127419s) [upload=429383]: Done uploading segments... Sep 18 21:51:48.713357910 (487h43m24.066143008s) [upload=429383]: Upload finished. err: metaclient: context deadline exceeded Duration:* 211.905203ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 505.115745ms FAIL (2025-09-18 22:31:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 505.13407ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 330.535862ms FAIL (2025-09-18 22:31:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 330.564197ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 177.5046ms FAIL (2025-09-18 22:31:37 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 177.522784ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 286.466285ms FAIL (2025-09-18 22:31:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Sep 18 21:51:18.726734295 (487h42m54.079519424s) [upload=429383]: Starting upload Sep 18 21:51:18.726861354 (487h42m54.079646542s) [upload=429383]: Done starting upload Sep 18 21:51:18.726936915 (487h42m54.079722053s) [upload=429383]: Uploading segments... Sep 18 21:51:18.726991948 (487h42m54.079777077s) [upload=429383]: Got next segment. Inline: true Sep 18 21:51:18.726998431 (487h42m54.079783569s) [upload=429383]: Waiting for error group managing segments... Sep 18 21:51:18.727045299 (487h42m54.079830436s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:18.727051290 (487h42m54.079836418s) [upload=429383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 18 21:51:18.727054927 (487h42m54.079840054s) [upload=429383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 18 21:51:48.713342311 (487h43m24.066127419s) [upload=429383]: Done uploading segments... Sep 18 21:51:48.713357910 (487h43m24.066143008s) [upload=429383]: Upload finished. err: metaclient: context deadline exceeded Duration:* 286.489149ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 729.908471ms FAIL (2025-09-18 22:30:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== Sep 18 21:51:24.200351040 (487h42m59.553136168s) [upload=429388]: Starting upload Sep 18 21:51:24.200460956 (487h42m59.553246094s) [upload=429388]: Done starting upload Sep 18 21:51:24.200636806 (487h42m59.553421934s) [upload=429388]: Uploading segments... Sep 18 21:51:24.200834708 (487h42m59.553619845s) [upload=429388]: Got next segment. Inline: false Sep 18 21:51:24.200966214 (487h42m59.553751352s) [upload=429388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 18 21:51:24.200975912 (487h42m59.55376105s) [upload=429388]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 18 21:51:54.188231392 (487h43m29.54101654s) [upload=429388]: Next segment err: context deadline exceeded Sep 18 21:51:54.188316552 (487h43m29.54110169s) [upload=429388]: Done uploading segments... Sep 18 21:51:54.188341990 (487h43m29.541127127s) [upload=429388]: Upload finished. err: context deadline exceeded Duration: 729.9346ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 220.270281ms FAIL (2025-09-18 22:30:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 220.293764ms core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)