Orbiter History

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..................................................X.........] duration: 119.541834ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-07 01:32:57 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 119.558877ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...................................................X........] duration: 136.272794ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-07 01:32:42 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 136.292049ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....................................................X.......] duration: 117.642021ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-07 01:31:28 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 117.680633ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....................................................X......] duration: 134.708968ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-07 01:30:18 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 134.731801ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......................................................X.....] duration: 117.920701ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-07 01:29:25 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 117.945438ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......................................................X....] duration: 114.485009ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-07 01:28:54 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 114.501309ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........................................................X...] duration: 116.406611ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-07 01:27:55 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 116.425897ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........................................................X..] duration: 118.427515ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-07 01:27:37 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 118.444927ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..........................................................X.] duration: 123.248709ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-07 01:27:11 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 123.268316ms edge linksharing bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 479.054223ms FAIL (2025-11-05 19:35:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 479.088367ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 380.371342ms FAIL (2025-11-05 19:34:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 380.393082ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 390.366086ms FAIL (2025-11-05 19:34:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 390.384049ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 472.18415ms FAIL (2025-11-05 19:33:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 472.206102ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X...X.......................................................] duration: 433.210193ms FAIL (2025-11-05 19:33:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 433.234689ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X...X......................................................] duration: 463.319183ms FAIL (2025-11-05 19:31:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 463.337978ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X...X.....................................................] duration: 443.694678ms FAIL (2025-11-05 19:30:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 443.720696ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X...X....................................................] duration: 370.634178ms FAIL (2025-11-05 19:30:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 370.653295ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X...X...................................................] duration: 499.120801ms FAIL (2025-11-05 19:29:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 499.160616ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X...X..................................................] duration: 443.304919ms FAIL (2025-11-05 19:29:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 443.328233ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X...X.................................................] duration: 458.057243ms FAIL (2025-11-05 19:28:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 458.088612ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X...X................................................] duration: 448.402951ms FAIL (2025-11-05 19:27:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 448.433738ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X...X...............................................] duration: 397.74888ms FAIL (2025-11-05 19:26:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 397.77062ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X...X..............................................] duration: 374.66485ms FAIL (2025-11-05 19:25:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 374.687302ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X...X.............................................] duration: 460.201947ms FAIL (2025-11-05 19:24:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 460.227434ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X...X............................................] duration: 358.340783ms FAIL (2025-11-05 19:23:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 358.369988ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X...X...........................................] duration: 452.479854ms FAIL (2025-11-05 19:22:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 452.500955ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X...X..........................................] duration: 408.37743ms FAIL (2025-11-05 19:22:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 408.444084ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X...X.........................................] duration: 478.369166ms FAIL (2025-11-05 19:21:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 478.391738ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X...X........................................] duration: 413.009085ms FAIL (2025-11-05 19:21:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 413.037348ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X...X.......................................] duration: 456.514724ms FAIL (2025-11-05 19:19:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 456.535181ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X...X......................................] duration: 453.247315ms FAIL (2025-11-05 19:18:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 453.274847ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X...X.....................................] duration: 476.761589ms FAIL (2025-11-05 19:18:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 476.782928ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X...X....................................] duration: 348.524246ms FAIL (2025-11-05 19:17:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 348.54845ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X...X...................................] duration: 411.213369ms FAIL (2025-11-05 19:16:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 411.233617ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration: 421.395709ms FAIL (2025-11-05 19:15:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 421.415505ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X...X.................................] duration: 475.833699ms FAIL (2025-11-05 19:14:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 475.864526ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...X................................] duration: 360.857097ms FAIL (2025-11-05 19:14:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 360.89612ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X...X...............................] duration: 432.263869ms FAIL (2025-11-05 19:13:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 432.287775ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X...X..............................] duration: 450.898706ms FAIL (2025-11-05 19:12:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 450.922682ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X...X.............................] duration: 425.200654ms FAIL (2025-11-05 19:11:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 425.226122ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X...X............................] duration: 350.977472ms FAIL (2025-11-05 19:11:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 350.999462ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X...X...........................] duration: 346.239388ms FAIL (2025-11-05 19:10:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 346.260227ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X...X..........................] duration: 419.196955ms FAIL (2025-11-05 19:09:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 419.216131ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X...X.........................] duration: 340.697212ms FAIL (2025-11-05 19:09:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 340.71262ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X...X........................] duration: 424.174811ms FAIL (2025-11-05 19:09:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 424.205959ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X...X.......................] duration: 423.288038ms FAIL (2025-11-05 19:08:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 423.306473ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X...X......................] duration: 416.767189ms FAIL (2025-11-05 19:07:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 416.791585ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X...X.....................] duration: 351.175383ms FAIL (2025-11-05 19:06:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 351.198997ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X...X....................] duration: 407.204855ms FAIL (2025-11-05 19:05:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 407.224002ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X...X...................] duration: 451.539718ms FAIL (2025-11-05 19:05:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 451.570665ms core uplink us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)