Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X...X..................] duration: 373.903315ms FAIL (2025-11-05 19:04:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 373.922802ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X...X.................] duration: 472.823081ms FAIL (2025-11-05 19:03:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 472.842508ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X...X................] duration: 425.990605ms FAIL (2025-11-05 19:02:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 426.011254ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X...X...............] duration: 460.777401ms FAIL (2025-11-05 19:02:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 460.795035ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X...X..............] duration: 455.778247ms FAIL (2025-11-05 19:01:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 455.797733ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [X..............] duration: 45.256322ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 19:01:19 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 45.278554ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X...X.............] duration: 430.799583ms FAIL (2025-11-05 19:00:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 430.818468ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.X.............] duration: 42.249921ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 19:00:25 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 42.28675ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X...X............] duration: 442.277871ms FAIL (2025-11-05 18:59:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 442.297607ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..X............] duration: 71.543295ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:59:31 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 71.560227ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [...X...........] duration: 49.103434ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:58:48 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 49.115678ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X...X...........] duration: 503.481497ms FAIL (2025-11-05 18:58:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 503.508345ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [....X..........] duration: 47.493028ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:58:14 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 47.513176ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X...X..........] duration: 459.713683ms FAIL (2025-11-05 18:57:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 459.735685ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X...X.........] duration: 430.159107ms FAIL (2025-11-05 18:57:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 430.181008ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.....X.........] duration: 47.407477ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:57:03 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 47.437543ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [......X........] duration: 44.757598ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:56:31 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 44.776554ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X...X........] duration: 317.091902ms FAIL (2025-11-05 18:56:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 317.132468ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X...X.......] duration: 440.56379ms FAIL (2025-11-05 18:55:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 440.584478ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X...X......] duration: 331.5356ms FAIL (2025-11-05 18:55:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 331.57345ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.......X.......] duration: 56.368342ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:55:20 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 56.387679ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X...X.....] duration: 459.403232ms FAIL (2025-11-05 18:54:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 459.433247ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [........X......] duration: 46.724897ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:54:13 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 46.780281ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X...X....] duration: 410.808727ms FAIL (2025-11-05 18:54:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 410.834686ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 136.102546ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:53:57 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 136.130218ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X...X...] duration: 431.903629ms FAIL (2025-11-05 18:53:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 431.924999ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 51.945448ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:53:02 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 51.965275ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X...X..] duration: 461.027908ms FAIL (2025-11-05 18:52:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 461.048146ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 68.751918ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:52:43 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 68.777806ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X...X.] duration: 530.517327ms FAIL (2025-11-05 18:52:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 530.54529ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X...X] duration: 30.019648687s FAIL (2025-11-05 18:52:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Nov 5 18:51:47.603206487 (223h38m14.304151372s) [upload=196754]: Starting upload Nov 5 18:51:47.603260698 (223h38m14.304205584s) [upload=196754]: Done starting upload Nov 5 18:51:47.603364924 (223h38m14.304309809s) [upload=196754]: Uploading segments... Nov 5 18:51:47.603476533 (223h38m14.304421419s) [upload=196754]: Got next segment. Inline: false Nov 5 18:51:47.603501400 (223h38m14.304446296s) [upload=196754]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:51:47.603504867 (223h38m14.304449752s) [upload=196754]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:51:47.627077815 (223h38m14.32802271s) [seg_pos={0 0}, upload=196754]: Begin upload segment... Nov 5 18:51:47.627118752 (223h38m14.328063647s) [seg_pos={0 0}, upload=196754]: Done begin upload segment. Nov 5 18:51:47.627138258 (223h38m14.328083154s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627146764 (223h38m14.328091649s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627460282 (223h38m14.328405167s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.627716022 (223h38m14.328660907s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628006226 (223h38m14.328951111s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628265643 (223h38m14.329210538s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628512426 (223h38m14.329457321s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.628806607 (223h38m14.329751492s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629093896 (223h38m14.330038781s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629365325 (223h38m14.33031022s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.629638086 (223h38m14.330582982s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630045591 (223h38m14.330990486s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.630491958 (223h38m14.331436853s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631033274 (223h38m14.331978209s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631481254 (223h38m14.332426149s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.631826531 (223h38m14.332771426s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Uploading piece... Nov 5 18:51:47.703446236 (223h38m14.404391141s) [upload=196754]: Next returned nil segment Nov 5 18:51:47.703460292 (223h38m14.404405197s) [upload=196754]: Waiting for error group managing segments... Nov 5 18:51:47.712257069 (223h38m14.413201964s) [noise=true , address=145.79.227.11:4730 , piece_id=WQLOD6E273PHPC3PVJUUB3GSAFKRNH6IAPCFIVDZTJSMLTQPPDJQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.712535933 (223h38m14.413480818s) [noise=true , address=145.79.227.18:4005 , piece_id=NF5DMRTEC3CBZRHDGNAUFLGRXRYA2XO5K4SEX2GR6WPFHMLB4U3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713193967 (223h38m14.414138862s) [noise=true , address=145.79.227.30:4762 , piece_id=I5SGBNSCBJFKHHMQQEMQOWUNZXQYCCRA2IZ5URGAQ2HSF3TD27EA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713206009 (223h38m14.414150894s) [noise=true , address=145.79.227.9:4365 , piece_id=QNNX6Z2MUPJ7RDQHUNCYAFHSSWCINKE46LFGGFIUD6M65EVT6I3Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.713702551 (223h38m14.414647435s) [noise=true , address=145.79.227.30:4763 , piece_id=XOFZ52VB2QNQKTMKTHUUQN2VQHN7GTTDKSHW6WTAIL7M35X7TBCA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714028221 (223h38m14.414973107s) [noise=true , address=145.79.227.8:4331 , piece_id=54RZQGZFVNI4EJKFBWTQEXG4XLQTFOKCZ4GJC7DO7NJLRN54K7SQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714182291 (223h38m14.415127175s) [noise=true , address=145.79.227.31:4798 , piece_id=ZHLZHG2DWR3WB3JJ2JHV4W5M6IVYZ57BONN7RDJT7ARQTP6EOSGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714355906 (223h38m14.415300801s) [noise=true , address=145.79.227.22:4511 , piece_id=BN3MTO636CYMZEMV3F256PQK2NYOGVIJPVI4RFMF2ZDQKK5VLQPQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714588412 (223h38m14.415533297s) [noise=true , address=145.79.227.24:4581 , piece_id=H2XOK4NE7BSLCSWDIUIBVXT4NMG2CFDT3HPF2DTELKFIENQYWIOQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.714652092 (223h38m14.415596976s) [noise=true , address=145.79.227.27:4690 , piece_id=TZT5ZWEANHWCVRHG247CKJVF3AWRU75LEJXXIT3KO2FIA5LEZZ5Q, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:51:47.722783451 (223h38m14.423728336s) [noise=true , address=145.79.227.16:4910 , piece_id=3MIJXK2DXZQ6HKWFZZ6DTYJDZYEFIEJZWVUD6XLH4Y6KTR4W4TLQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: <nil> Nov 5 18:52:17.590157664 (223h38m44.291102549s) [noise=true , address=45.91.116.11:4117 , piece_id=R7O5OPDCPJPGHLBJQWGDR5OEW643LEW653FHDUCMG4AMBCTBKAFQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 5.161.89.252:58372->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590188823 (223h38m44.291133707s) [noise=true , address=45.91.116.8:4047 , piece_id=BHAKKQVNNYCHS3HFMDE4SKPNAM6T5YSL5KMST4KY2F7IPKQWCUGA, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: rpc: dial tcp 45.91.116.8:4047: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590291024 (223h38m44.291235909s) [noise=true , address=77.90.31.21:4879 , piece_id=DDOGXY6SEQSAO2NFX7W7KKXT2YWATXHYZKBX3FQQV3GZ7ERKIZRQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:53576->77.90.31.21:4879: use of closed network connection Nov 5 18:52:17.590327893 (223h38m44.291272788s) [noise=true , address=77.90.31.18:4806 , piece_id=N3J7XEXG2XKOANW7L2E32HUOEM7FLAJ3D6TTMCC75LES67F2BNHQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:38784->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 5 18:52:17.590363249 (223h38m44.291308135s) [noise=true , address=77.90.31.17:4771 , piece_id=ELFCIIDQZAJN2DQEAOFTQDIRAFT7GV7IX3U3UVXMZRKRQ4634JEQ, seg_pos={0 0}, upload=196754]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42562->77.90.31.17:4771: use of closed network connection Nov 5 18:52:17.590386313 (223h38m44.291331198s) [seg_pos={0 0}, upload=196754]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Nov 5 18:52:17.607523962 (223h38m44.308468857s) [upload=196754]: Done uploading segments... Nov 5 18:52:17.607536145 (223h38m44.30848104s) [upload=196754]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.019666561s core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 91.754305ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:51:33 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 91.774172ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 385.370621ms FAIL (2025-11-05 18:51:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Nov 5 18:48:20.825342059 (223h34m47.526286954s) [upload=196703]: Starting upload Nov 5 18:48:20.825411399 (223h34m47.526356294s) [upload=196703]: Done starting upload Nov 5 18:48:20.825526725 (223h34m47.52647163s) [upload=196703]: Uploading segments... Nov 5 18:48:20.825646971 (223h34m47.526591866s) [upload=196703]: Got next segment. Inline: false Nov 5 18:48:20.825690983 (223h34m47.526635878s) [upload=196703]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:48:20.825697195 (223h34m47.52664209s) [upload=196703]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:48:20.849410077 (223h34m47.550354961s) [seg_pos={0 0}, upload=196703]: Begin upload segment... Nov 5 18:48:20.849460711 (223h34m47.550405607s) [seg_pos={0 0}, upload=196703]: Done begin upload segment. Nov 5 18:48:20.849481421 (223h34m47.550426316s) [noise=true , address=45.91.116.7:4010 , piece_id=BQU33X23V3QGNX23ME3UGGAJ53JGJ7DAUXSERXB7CHPYUN6Q7QPQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.849504103 (223h34m47.550448988s) [noise=true , address=45.91.116.13:4155 , piece_id=S5YQHU342XFSBEKZACCRBMGHN7HRTGCMNYL4Y2G6TN7FGWVRPX7Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.849844792 (223h34m47.550789687s) [noise=true , address=145.79.227.30:4761 , piece_id=7ZFX4ERU56GLRS2XHJLQHJR5G6IGKRNQEWQG56X5ICSO4T2JQU7A, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850143262 (223h34m47.551088157s) [noise=true , address=77.90.31.19:4842 , piece_id=UHEWZW4KZA52YONZW53LBYYR4ICMLLCZ6O2WE7FEHZZ3DVFSLL3Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850377140 (223h34m47.551322036s) [noise=true , address=145.79.227.25:4618 , piece_id=YCJ3DJGDHFXQHVKSFXKHASDFSSCDFYVE76YZLMS6U6KVRK4WBWKQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850616418 (223h34m47.551561314s) [noise=true , address=145.79.227.15:4874 , piece_id=3TAXN32PKJBJWZXOEOP22JMOIRO6K4DA47XQZ3WGXTCS4KJ2O6IQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850850938 (223h34m47.551795823s) [noise=true , address=145.79.227.25:4617 , piece_id=WWFDJOPHNSEKYKY34GHYUOYQZLPPT63HHCWYOGHMGOCJAFESPRUQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.851135321 (223h34m47.552080217s) [noise=true , address=145.79.227.31:4799 , piece_id=Q4UFQ6B45LWDAXOHYJPRDQGOV6E3WN2UESBNS2S7FHYKDYL34MHQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.851397453 (223h34m47.552342338s) [noise=true , address=145.79.227.26:4655 , piece_id=MA4RY2IZDJRFW4WYFYZGOKXOCVJKT2LL2EEV4LBNC3BSTCDHRFAQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852034759 (223h34m47.552979654s) [noise=true , address=145.79.227.20:4438 , piece_id=2R63V7MXWSSCSX7YU23L7PXP6MGD46IL6BZG7FRZ2WKDFVERF5FQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852342055 (223h34m47.553286939s) [noise=true , address=145.79.227.9:4365 , piece_id=3HXG4D7RMZBUF7DDI3HVZTJIRRRHQCIIYCZJNB4BJIS7HIFQRSGA, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852610147 (223h34m47.553555032s) [noise=true , address=145.79.227.18:4005 , piece_id=WF252CZZCGFYOHYAITTUXS46PY34RH4QMN6XXA3DP6SG2TOVQS4Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852874082 (223h34m47.553818967s) [noise=true , address=77.90.31.21:4878 , piece_id=2MFPRSSNKOHMJHHEZDEPZDT5YPZ3UQ5OKIHR6M5NASV7ZNEAIJQQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853182250 (223h34m47.554127145s) [noise=true , address=145.79.227.21:4474 , piece_id=24UHKJH564D6WPKODBXXQ2QSTWEDRUYQXBE2RTYZUFEB4BYYRK4Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853523040 (223h34m47.554467925s) [noise=true , address=145.79.227.14:4840 , piece_id=OFOWRW6Q533LOF4OWF2GFGUTZLLKZ7AOFQC3YU3ZBTX27DHTJ7VA, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853886682 (223h34m47.554831577s) [noise=true , address=145.79.227.32:4836 , piece_id=VPNNG5GNAZ7FCM273B3BEMAF7M5ZFOWMDYQM3RWDFNWSTMD5PRAQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.932879955 (223h34m47.63382485s) [upload=196703]: Next returned nil segment Nov 5 18:48:20.932898660 (223h34m47.633843575s) [upload=196703]: Waiting for error group managing segments... Nov 5 18:48:20.944238947 (223h34m47.645183832s) [noise=true , address=145.79.227.25:4618 , piece_id=YCJ3DJGDHFXQHVKSFXKHASDFSSCDFYVE76YZLMS6U6KVRK4WBWKQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.944617517 (223h34m47.645562412s) [noise=true , address=145.79.227.9:4365 , piece_id=3HXG4D7RMZBUF7DDI3HVZTJIRRRHQCIIYCZJNB4BJIS7HIFQRSGA, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.944989124 (223h34m47.64593402s) [noise=true , address=145.79.227.31:4799 , piece_id=Q4UFQ6B45LWDAXOHYJPRDQGOV6E3WN2UESBNS2S7FHYKDYL34MHQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945030902 (223h34m47.645975788s) [noise=true , address=145.79.227.20:4438 , piece_id=2R63V7MXWSSCSX7YU23L7PXP6MGD46IL6BZG7FRZ2WKDFVERF5FQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945309335 (223h34m47.64625422s) [noise=true , address=145.79.227.32:4836 , piece_id=VPNNG5GNAZ7FCM273B3BEMAF7M5ZFOWMDYQM3RWDFNWSTMD5PRAQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945591414 (223h34m47.646536309s) [noise=true , address=145.79.227.21:4474 , piece_id=24UHKJH564D6WPKODBXXQ2QSTWEDRUYQXBE2RTYZUFEB4BYYRK4Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945628734 (223h34m47.646573629s) [noise=true , address=145.79.227.15:4874 , piece_id=3TAXN32PKJBJWZXOEOP22JMOIRO6K4DA47XQZ3WGXTCS4KJ2O6IQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946052789 (223h34m47.646997674s) [noise=true , address=145.79.227.26:4655 , piece_id=MA4RY2IZDJRFW4WYFYZGOKXOCVJKT2LL2EEV4LBNC3BSTCDHRFAQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946069490 (223h34m47.647014385s) [noise=true , address=145.79.227.30:4761 , piece_id=7ZFX4ERU56GLRS2XHJLQHJR5G6IGKRNQEWQG56X5ICSO4T2JQU7A, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946372208 (223h34m47.647317103s) [noise=true , address=145.79.227.18:4005 , piece_id=WF252CZZCGFYOHYAITTUXS46PY34RH4QMN6XXA3DP6SG2TOVQS4Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946479700 (223h34m47.647424585s) [noise=true , address=145.79.227.14:4840 , piece_id=OFOWRW6Q533LOF4OWF2GFGUTZLLKZ7AOFQC3YU3ZBTX27DHTJ7VA, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946706545 (223h34m47.647651441s) [noise=true , address=145.79.227.25:4617 , piece_id=WWFDJOPHNSEKYKY34GHYUOYQZLPPT63HHCWYOGHMGOCJAFESPRUQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:50.813745800 (223h35m17.514690715s) [noise=true , address=77.90.31.21:4878 , piece_id=2MFPRSSNKOHMJHHEZDEPZDT5YPZ3UQ5OKIHR6M5NASV7ZNEAIJQQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection; write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection Nov 5 18:48:50.813791646 (223h35m17.514736561s) [noise=true , address=45.91.116.13:4155 , piece_id=S5YQHU342XFSBEKZACCRBMGHN7HRTGCMNYL4Y2G6TN7FGWVRPX7Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection Nov 5 18:48:50.813873449 (223h35m17.514818365s) [noise=true , address=77.90.31.19:4842 , piece_id=UHEWZW4KZA52YONZW53LBYYR4ICMLLCZ6O2WE7FEHZZ3DVFSLL3Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection; write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection Nov 5 18:48:50.814160668 (223h35m17.515105574s) [noise=true , address=45.91.116.7:4010 , piece_id=BQU33X23V3QGNX23ME3UGGAJ53JGJ7DAUXSERXB7CHPYUN6Q7QPQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: context deadline exceeded; context deadline exceeded Nov 5 18:48:50.814198479 (223h35m17.515143394s) [seg_pos={0 0}, upload=196703]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Nov 5 18:48:50.829782465 (223h35m17.53072738s) [upload=196703]: Done uploading segments... Nov 5 18:48:50.829803484 (223h35m17.5307484s) [upload=196703]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 385.388545ms core uplink us-select-1
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [.............X.] duration: 141.401102ms remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:50:34 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 141.433462ms core website
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 11.10570376s remote: "tcp:34.120.119.150:443" target: https://www.tardigrade.io/ FAIL (2025-11-05 18:50:12 UTC) orbiter warning: Get "https://www.tardigrade.io/": EOF Duration: 11.105721304s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 363.904793ms FAIL (2025-11-05 18:50:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Nov 5 18:48:20.825342059 (223h34m47.526286954s) [upload=196703]: Starting upload Nov 5 18:48:20.825411399 (223h34m47.526356294s) [upload=196703]: Done starting upload Nov 5 18:48:20.825526725 (223h34m47.52647163s) [upload=196703]: Uploading segments... Nov 5 18:48:20.825646971 (223h34m47.526591866s) [upload=196703]: Got next segment. Inline: false Nov 5 18:48:20.825690983 (223h34m47.526635878s) [upload=196703]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:48:20.825697195 (223h34m47.52664209s) [upload=196703]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:48:20.849410077 (223h34m47.550354961s) [seg_pos={0 0}, upload=196703]: Begin upload segment... Nov 5 18:48:20.849460711 (223h34m47.550405607s) [seg_pos={0 0}, upload=196703]: Done begin upload segment. Nov 5 18:48:20.849481421 (223h34m47.550426316s) [noise=true , address=45.91.116.7:4010 , piece_id=BQU33X23V3QGNX23ME3UGGAJ53JGJ7DAUXSERXB7CHPYUN6Q7QPQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.849504103 (223h34m47.550448988s) [noise=true , address=45.91.116.13:4155 , piece_id=S5YQHU342XFSBEKZACCRBMGHN7HRTGCMNYL4Y2G6TN7FGWVRPX7Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.849844792 (223h34m47.550789687s) [noise=true , address=145.79.227.30:4761 , piece_id=7ZFX4ERU56GLRS2XHJLQHJR5G6IGKRNQEWQG56X5ICSO4T2JQU7A, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850143262 (223h34m47.551088157s) [noise=true , address=77.90.31.19:4842 , piece_id=UHEWZW4KZA52YONZW53LBYYR4ICMLLCZ6O2WE7FEHZZ3DVFSLL3Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850377140 (223h34m47.551322036s) [noise=true , address=145.79.227.25:4618 , piece_id=YCJ3DJGDHFXQHVKSFXKHASDFSSCDFYVE76YZLMS6U6KVRK4WBWKQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850616418 (223h34m47.551561314s) [noise=true , address=145.79.227.15:4874 , piece_id=3TAXN32PKJBJWZXOEOP22JMOIRO6K4DA47XQZ3WGXTCS4KJ2O6IQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850850938 (223h34m47.551795823s) [noise=true , address=145.79.227.25:4617 , piece_id=WWFDJOPHNSEKYKY34GHYUOYQZLPPT63HHCWYOGHMGOCJAFESPRUQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.851135321 (223h34m47.552080217s) [noise=true , address=145.79.227.31:4799 , piece_id=Q4UFQ6B45LWDAXOHYJPRDQGOV6E3WN2UESBNS2S7FHYKDYL34MHQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.851397453 (223h34m47.552342338s) [noise=true , address=145.79.227.26:4655 , piece_id=MA4RY2IZDJRFW4WYFYZGOKXOCVJKT2LL2EEV4LBNC3BSTCDHRFAQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852034759 (223h34m47.552979654s) [noise=true , address=145.79.227.20:4438 , piece_id=2R63V7MXWSSCSX7YU23L7PXP6MGD46IL6BZG7FRZ2WKDFVERF5FQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852342055 (223h34m47.553286939s) [noise=true , address=145.79.227.9:4365 , piece_id=3HXG4D7RMZBUF7DDI3HVZTJIRRRHQCIIYCZJNB4BJIS7HIFQRSGA, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852610147 (223h34m47.553555032s) [noise=true , address=145.79.227.18:4005 , piece_id=WF252CZZCGFYOHYAITTUXS46PY34RH4QMN6XXA3DP6SG2TOVQS4Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852874082 (223h34m47.553818967s) [noise=true , address=77.90.31.21:4878 , piece_id=2MFPRSSNKOHMJHHEZDEPZDT5YPZ3UQ5OKIHR6M5NASV7ZNEAIJQQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853182250 (223h34m47.554127145s) [noise=true , address=145.79.227.21:4474 , piece_id=24UHKJH564D6WPKODBXXQ2QSTWEDRUYQXBE2RTYZUFEB4BYYRK4Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853523040 (223h34m47.554467925s) [noise=true , address=145.79.227.14:4840 , piece_id=OFOWRW6Q533LOF4OWF2GFGUTZLLKZ7AOFQC3YU3ZBTX27DHTJ7VA, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853886682 (223h34m47.554831577s) [noise=true , address=145.79.227.32:4836 , piece_id=VPNNG5GNAZ7FCM273B3BEMAF7M5ZFOWMDYQM3RWDFNWSTMD5PRAQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.932879955 (223h34m47.63382485s) [upload=196703]: Next returned nil segment Nov 5 18:48:20.932898660 (223h34m47.633843575s) [upload=196703]: Waiting for error group managing segments... Nov 5 18:48:20.944238947 (223h34m47.645183832s) [noise=true , address=145.79.227.25:4618 , piece_id=YCJ3DJGDHFXQHVKSFXKHASDFSSCDFYVE76YZLMS6U6KVRK4WBWKQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.944617517 (223h34m47.645562412s) [noise=true , address=145.79.227.9:4365 , piece_id=3HXG4D7RMZBUF7DDI3HVZTJIRRRHQCIIYCZJNB4BJIS7HIFQRSGA, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.944989124 (223h34m47.64593402s) [noise=true , address=145.79.227.31:4799 , piece_id=Q4UFQ6B45LWDAXOHYJPRDQGOV6E3WN2UESBNS2S7FHYKDYL34MHQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945030902 (223h34m47.645975788s) [noise=true , address=145.79.227.20:4438 , piece_id=2R63V7MXWSSCSX7YU23L7PXP6MGD46IL6BZG7FRZ2WKDFVERF5FQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945309335 (223h34m47.64625422s) [noise=true , address=145.79.227.32:4836 , piece_id=VPNNG5GNAZ7FCM273B3BEMAF7M5ZFOWMDYQM3RWDFNWSTMD5PRAQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945591414 (223h34m47.646536309s) [noise=true , address=145.79.227.21:4474 , piece_id=24UHKJH564D6WPKODBXXQ2QSTWEDRUYQXBE2RTYZUFEB4BYYRK4Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945628734 (223h34m47.646573629s) [noise=true , address=145.79.227.15:4874 , piece_id=3TAXN32PKJBJWZXOEOP22JMOIRO6K4DA47XQZ3WGXTCS4KJ2O6IQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946052789 (223h34m47.646997674s) [noise=true , address=145.79.227.26:4655 , piece_id=MA4RY2IZDJRFW4WYFYZGOKXOCVJKT2LL2EEV4LBNC3BSTCDHRFAQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946069490 (223h34m47.647014385s) [noise=true , address=145.79.227.30:4761 , piece_id=7ZFX4ERU56GLRS2XHJLQHJR5G6IGKRNQEWQG56X5ICSO4T2JQU7A, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946372208 (223h34m47.647317103s) [noise=true , address=145.79.227.18:4005 , piece_id=WF252CZZCGFYOHYAITTUXS46PY34RH4QMN6XXA3DP6SG2TOVQS4Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946479700 (223h34m47.647424585s) [noise=true , address=145.79.227.14:4840 , piece_id=OFOWRW6Q533LOF4OWF2GFGUTZLLKZ7AOFQC3YU3ZBTX27DHTJ7VA, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946706545 (223h34m47.647651441s) [noise=true , address=145.79.227.25:4617 , piece_id=WWFDJOPHNSEKYKY34GHYUOYQZLPPT63HHCWYOGHMGOCJAFESPRUQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:50.813745800 (223h35m17.514690715s) [noise=true , address=77.90.31.21:4878 , piece_id=2MFPRSSNKOHMJHHEZDEPZDT5YPZ3UQ5OKIHR6M5NASV7ZNEAIJQQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection; write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection Nov 5 18:48:50.813791646 (223h35m17.514736561s) [noise=true , address=45.91.116.13:4155 , piece_id=S5YQHU342XFSBEKZACCRBMGHN7HRTGCMNYL4Y2G6TN7FGWVRPX7Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection Nov 5 18:48:50.813873449 (223h35m17.514818365s) [noise=true , address=77.90.31.19:4842 , piece_id=UHEWZW4KZA52YONZW53LBYYR4ICMLLCZ6O2WE7FEHZZ3DVFSLL3Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection; write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection Nov 5 18:48:50.814160668 (223h35m17.515105574s) [noise=true , address=45.91.116.7:4010 , piece_id=BQU33X23V3QGNX23ME3UGGAJ53JGJ7DAUXSERXB7CHPYUN6Q7QPQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: context deadline exceeded; context deadline exceeded Nov 5 18:48:50.814198479 (223h35m17.515143394s) [seg_pos={0 0}, upload=196703]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Nov 5 18:48:50.829782465 (223h35m17.53072738s) [upload=196703]: Done uploading segments... Nov 5 18:48:50.829803484 (223h35m17.5307484s) [upload=196703]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 363.927586ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 539.299288ms FAIL (2025-11-05 18:49:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Nov 5 18:48:20.825342059 (223h34m47.526286954s) [upload=196703]: Starting upload Nov 5 18:48:20.825411399 (223h34m47.526356294s) [upload=196703]: Done starting upload Nov 5 18:48:20.825526725 (223h34m47.52647163s) [upload=196703]: Uploading segments... Nov 5 18:48:20.825646971 (223h34m47.526591866s) [upload=196703]: Got next segment. Inline: false Nov 5 18:48:20.825690983 (223h34m47.526635878s) [upload=196703]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:48:20.825697195 (223h34m47.52664209s) [upload=196703]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:48:20.849410077 (223h34m47.550354961s) [seg_pos={0 0}, upload=196703]: Begin upload segment... Nov 5 18:48:20.849460711 (223h34m47.550405607s) [seg_pos={0 0}, upload=196703]: Done begin upload segment. Nov 5 18:48:20.849481421 (223h34m47.550426316s) [noise=true , address=45.91.116.7:4010 , piece_id=BQU33X23V3QGNX23ME3UGGAJ53JGJ7DAUXSERXB7CHPYUN6Q7QPQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.849504103 (223h34m47.550448988s) [noise=true , address=45.91.116.13:4155 , piece_id=S5YQHU342XFSBEKZACCRBMGHN7HRTGCMNYL4Y2G6TN7FGWVRPX7Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.849844792 (223h34m47.550789687s) [noise=true , address=145.79.227.30:4761 , piece_id=7ZFX4ERU56GLRS2XHJLQHJR5G6IGKRNQEWQG56X5ICSO4T2JQU7A, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850143262 (223h34m47.551088157s) [noise=true , address=77.90.31.19:4842 , piece_id=UHEWZW4KZA52YONZW53LBYYR4ICMLLCZ6O2WE7FEHZZ3DVFSLL3Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850377140 (223h34m47.551322036s) [noise=true , address=145.79.227.25:4618 , piece_id=YCJ3DJGDHFXQHVKSFXKHASDFSSCDFYVE76YZLMS6U6KVRK4WBWKQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850616418 (223h34m47.551561314s) [noise=true , address=145.79.227.15:4874 , piece_id=3TAXN32PKJBJWZXOEOP22JMOIRO6K4DA47XQZ3WGXTCS4KJ2O6IQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850850938 (223h34m47.551795823s) [noise=true , address=145.79.227.25:4617 , piece_id=WWFDJOPHNSEKYKY34GHYUOYQZLPPT63HHCWYOGHMGOCJAFESPRUQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.851135321 (223h34m47.552080217s) [noise=true , address=145.79.227.31:4799 , piece_id=Q4UFQ6B45LWDAXOHYJPRDQGOV6E3WN2UESBNS2S7FHYKDYL34MHQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.851397453 (223h34m47.552342338s) [noise=true , address=145.79.227.26:4655 , piece_id=MA4RY2IZDJRFW4WYFYZGOKXOCVJKT2LL2EEV4LBNC3BSTCDHRFAQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852034759 (223h34m47.552979654s) [noise=true , address=145.79.227.20:4438 , piece_id=2R63V7MXWSSCSX7YU23L7PXP6MGD46IL6BZG7FRZ2WKDFVERF5FQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852342055 (223h34m47.553286939s) [noise=true , address=145.79.227.9:4365 , piece_id=3HXG4D7RMZBUF7DDI3HVZTJIRRRHQCIIYCZJNB4BJIS7HIFQRSGA, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852610147 (223h34m47.553555032s) [noise=true , address=145.79.227.18:4005 , piece_id=WF252CZZCGFYOHYAITTUXS46PY34RH4QMN6XXA3DP6SG2TOVQS4Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852874082 (223h34m47.553818967s) [noise=true , address=77.90.31.21:4878 , piece_id=2MFPRSSNKOHMJHHEZDEPZDT5YPZ3UQ5OKIHR6M5NASV7ZNEAIJQQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853182250 (223h34m47.554127145s) [noise=true , address=145.79.227.21:4474 , piece_id=24UHKJH564D6WPKODBXXQ2QSTWEDRUYQXBE2RTYZUFEB4BYYRK4Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853523040 (223h34m47.554467925s) [noise=true , address=145.79.227.14:4840 , piece_id=OFOWRW6Q533LOF4OWF2GFGUTZLLKZ7AOFQC3YU3ZBTX27DHTJ7VA, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853886682 (223h34m47.554831577s) [noise=true , address=145.79.227.32:4836 , piece_id=VPNNG5GNAZ7FCM273B3BEMAF7M5ZFOWMDYQM3RWDFNWSTMD5PRAQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.932879955 (223h34m47.63382485s) [upload=196703]: Next returned nil segment Nov 5 18:48:20.932898660 (223h34m47.633843575s) [upload=196703]: Waiting for error group managing segments... Nov 5 18:48:20.944238947 (223h34m47.645183832s) [noise=true , address=145.79.227.25:4618 , piece_id=YCJ3DJGDHFXQHVKSFXKHASDFSSCDFYVE76YZLMS6U6KVRK4WBWKQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.944617517 (223h34m47.645562412s) [noise=true , address=145.79.227.9:4365 , piece_id=3HXG4D7RMZBUF7DDI3HVZTJIRRRHQCIIYCZJNB4BJIS7HIFQRSGA, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.944989124 (223h34m47.64593402s) [noise=true , address=145.79.227.31:4799 , piece_id=Q4UFQ6B45LWDAXOHYJPRDQGOV6E3WN2UESBNS2S7FHYKDYL34MHQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945030902 (223h34m47.645975788s) [noise=true , address=145.79.227.20:4438 , piece_id=2R63V7MXWSSCSX7YU23L7PXP6MGD46IL6BZG7FRZ2WKDFVERF5FQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945309335 (223h34m47.64625422s) [noise=true , address=145.79.227.32:4836 , piece_id=VPNNG5GNAZ7FCM273B3BEMAF7M5ZFOWMDYQM3RWDFNWSTMD5PRAQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945591414 (223h34m47.646536309s) [noise=true , address=145.79.227.21:4474 , piece_id=24UHKJH564D6WPKODBXXQ2QSTWEDRUYQXBE2RTYZUFEB4BYYRK4Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945628734 (223h34m47.646573629s) [noise=true , address=145.79.227.15:4874 , piece_id=3TAXN32PKJBJWZXOEOP22JMOIRO6K4DA47XQZ3WGXTCS4KJ2O6IQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946052789 (223h34m47.646997674s) [noise=true , address=145.79.227.26:4655 , piece_id=MA4RY2IZDJRFW4WYFYZGOKXOCVJKT2LL2EEV4LBNC3BSTCDHRFAQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946069490 (223h34m47.647014385s) [noise=true , address=145.79.227.30:4761 , piece_id=7ZFX4ERU56GLRS2XHJLQHJR5G6IGKRNQEWQG56X5ICSO4T2JQU7A, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946372208 (223h34m47.647317103s) [noise=true , address=145.79.227.18:4005 , piece_id=WF252CZZCGFYOHYAITTUXS46PY34RH4QMN6XXA3DP6SG2TOVQS4Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946479700 (223h34m47.647424585s) [noise=true , address=145.79.227.14:4840 , piece_id=OFOWRW6Q533LOF4OWF2GFGUTZLLKZ7AOFQC3YU3ZBTX27DHTJ7VA, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946706545 (223h34m47.647651441s) [noise=true , address=145.79.227.25:4617 , piece_id=WWFDJOPHNSEKYKY34GHYUOYQZLPPT63HHCWYOGHMGOCJAFESPRUQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:50.813745800 (223h35m17.514690715s) [noise=true , address=77.90.31.21:4878 , piece_id=2MFPRSSNKOHMJHHEZDEPZDT5YPZ3UQ5OKIHR6M5NASV7ZNEAIJQQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection; write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection Nov 5 18:48:50.813791646 (223h35m17.514736561s) [noise=true , address=45.91.116.13:4155 , piece_id=S5YQHU342XFSBEKZACCRBMGHN7HRTGCMNYL4Y2G6TN7FGWVRPX7Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection Nov 5 18:48:50.813873449 (223h35m17.514818365s) [noise=true , address=77.90.31.19:4842 , piece_id=UHEWZW4KZA52YONZW53LBYYR4ICMLLCZ6O2WE7FEHZZ3DVFSLL3Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection; write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection Nov 5 18:48:50.814160668 (223h35m17.515105574s) [noise=true , address=45.91.116.7:4010 , piece_id=BQU33X23V3QGNX23ME3UGGAJ53JGJ7DAUXSERXB7CHPYUN6Q7QPQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: context deadline exceeded; context deadline exceeded Nov 5 18:48:50.814198479 (223h35m17.515143394s) [seg_pos={0 0}, upload=196703]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Nov 5 18:48:50.829782465 (223h35m17.53072738s) [upload=196703]: Done uploading segments... Nov 5 18:48:50.829803484 (223h35m17.5307484s) [upload=196703]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 539.319675ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.017518032s FAIL (2025-11-05 18:48:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Nov 5 18:48:20.825342059 (223h34m47.526286954s) [upload=196703]: Starting upload Nov 5 18:48:20.825411399 (223h34m47.526356294s) [upload=196703]: Done starting upload Nov 5 18:48:20.825526725 (223h34m47.52647163s) [upload=196703]: Uploading segments... Nov 5 18:48:20.825646971 (223h34m47.526591866s) [upload=196703]: Got next segment. Inline: false Nov 5 18:48:20.825690983 (223h34m47.526635878s) [upload=196703]: Flush batch item: pb.BatchRequestItem_ObjectBegin Nov 5 18:48:20.825697195 (223h34m47.52664209s) [upload=196703]: Flush batch item: pb.BatchRequestItem_SegmentBegin Nov 5 18:48:20.849410077 (223h34m47.550354961s) [seg_pos={0 0}, upload=196703]: Begin upload segment... Nov 5 18:48:20.849460711 (223h34m47.550405607s) [seg_pos={0 0}, upload=196703]: Done begin upload segment. Nov 5 18:48:20.849481421 (223h34m47.550426316s) [noise=true , address=45.91.116.7:4010 , piece_id=BQU33X23V3QGNX23ME3UGGAJ53JGJ7DAUXSERXB7CHPYUN6Q7QPQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.849504103 (223h34m47.550448988s) [noise=true , address=45.91.116.13:4155 , piece_id=S5YQHU342XFSBEKZACCRBMGHN7HRTGCMNYL4Y2G6TN7FGWVRPX7Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.849844792 (223h34m47.550789687s) [noise=true , address=145.79.227.30:4761 , piece_id=7ZFX4ERU56GLRS2XHJLQHJR5G6IGKRNQEWQG56X5ICSO4T2JQU7A, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850143262 (223h34m47.551088157s) [noise=true , address=77.90.31.19:4842 , piece_id=UHEWZW4KZA52YONZW53LBYYR4ICMLLCZ6O2WE7FEHZZ3DVFSLL3Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850377140 (223h34m47.551322036s) [noise=true , address=145.79.227.25:4618 , piece_id=YCJ3DJGDHFXQHVKSFXKHASDFSSCDFYVE76YZLMS6U6KVRK4WBWKQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850616418 (223h34m47.551561314s) [noise=true , address=145.79.227.15:4874 , piece_id=3TAXN32PKJBJWZXOEOP22JMOIRO6K4DA47XQZ3WGXTCS4KJ2O6IQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.850850938 (223h34m47.551795823s) [noise=true , address=145.79.227.25:4617 , piece_id=WWFDJOPHNSEKYKY34GHYUOYQZLPPT63HHCWYOGHMGOCJAFESPRUQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.851135321 (223h34m47.552080217s) [noise=true , address=145.79.227.31:4799 , piece_id=Q4UFQ6B45LWDAXOHYJPRDQGOV6E3WN2UESBNS2S7FHYKDYL34MHQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.851397453 (223h34m47.552342338s) [noise=true , address=145.79.227.26:4655 , piece_id=MA4RY2IZDJRFW4WYFYZGOKXOCVJKT2LL2EEV4LBNC3BSTCDHRFAQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852034759 (223h34m47.552979654s) [noise=true , address=145.79.227.20:4438 , piece_id=2R63V7MXWSSCSX7YU23L7PXP6MGD46IL6BZG7FRZ2WKDFVERF5FQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852342055 (223h34m47.553286939s) [noise=true , address=145.79.227.9:4365 , piece_id=3HXG4D7RMZBUF7DDI3HVZTJIRRRHQCIIYCZJNB4BJIS7HIFQRSGA, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852610147 (223h34m47.553555032s) [noise=true , address=145.79.227.18:4005 , piece_id=WF252CZZCGFYOHYAITTUXS46PY34RH4QMN6XXA3DP6SG2TOVQS4Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.852874082 (223h34m47.553818967s) [noise=true , address=77.90.31.21:4878 , piece_id=2MFPRSSNKOHMJHHEZDEPZDT5YPZ3UQ5OKIHR6M5NASV7ZNEAIJQQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853182250 (223h34m47.554127145s) [noise=true , address=145.79.227.21:4474 , piece_id=24UHKJH564D6WPKODBXXQ2QSTWEDRUYQXBE2RTYZUFEB4BYYRK4Q, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853523040 (223h34m47.554467925s) [noise=true , address=145.79.227.14:4840 , piece_id=OFOWRW6Q533LOF4OWF2GFGUTZLLKZ7AOFQC3YU3ZBTX27DHTJ7VA, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.853886682 (223h34m47.554831577s) [noise=true , address=145.79.227.32:4836 , piece_id=VPNNG5GNAZ7FCM273B3BEMAF7M5ZFOWMDYQM3RWDFNWSTMD5PRAQ, seg_pos={0 0}, upload=196703]: Uploading piece... Nov 5 18:48:20.932879955 (223h34m47.63382485s) [upload=196703]: Next returned nil segment Nov 5 18:48:20.932898660 (223h34m47.633843575s) [upload=196703]: Waiting for error group managing segments... Nov 5 18:48:20.944238947 (223h34m47.645183832s) [noise=true , address=145.79.227.25:4618 , piece_id=YCJ3DJGDHFXQHVKSFXKHASDFSSCDFYVE76YZLMS6U6KVRK4WBWKQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.944617517 (223h34m47.645562412s) [noise=true , address=145.79.227.9:4365 , piece_id=3HXG4D7RMZBUF7DDI3HVZTJIRRRHQCIIYCZJNB4BJIS7HIFQRSGA, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.944989124 (223h34m47.64593402s) [noise=true , address=145.79.227.31:4799 , piece_id=Q4UFQ6B45LWDAXOHYJPRDQGOV6E3WN2UESBNS2S7FHYKDYL34MHQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945030902 (223h34m47.645975788s) [noise=true , address=145.79.227.20:4438 , piece_id=2R63V7MXWSSCSX7YU23L7PXP6MGD46IL6BZG7FRZ2WKDFVERF5FQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945309335 (223h34m47.64625422s) [noise=true , address=145.79.227.32:4836 , piece_id=VPNNG5GNAZ7FCM273B3BEMAF7M5ZFOWMDYQM3RWDFNWSTMD5PRAQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945591414 (223h34m47.646536309s) [noise=true , address=145.79.227.21:4474 , piece_id=24UHKJH564D6WPKODBXXQ2QSTWEDRUYQXBE2RTYZUFEB4BYYRK4Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.945628734 (223h34m47.646573629s) [noise=true , address=145.79.227.15:4874 , piece_id=3TAXN32PKJBJWZXOEOP22JMOIRO6K4DA47XQZ3WGXTCS4KJ2O6IQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946052789 (223h34m47.646997674s) [noise=true , address=145.79.227.26:4655 , piece_id=MA4RY2IZDJRFW4WYFYZGOKXOCVJKT2LL2EEV4LBNC3BSTCDHRFAQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946069490 (223h34m47.647014385s) [noise=true , address=145.79.227.30:4761 , piece_id=7ZFX4ERU56GLRS2XHJLQHJR5G6IGKRNQEWQG56X5ICSO4T2JQU7A, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946372208 (223h34m47.647317103s) [noise=true , address=145.79.227.18:4005 , piece_id=WF252CZZCGFYOHYAITTUXS46PY34RH4QMN6XXA3DP6SG2TOVQS4Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946479700 (223h34m47.647424585s) [noise=true , address=145.79.227.14:4840 , piece_id=OFOWRW6Q533LOF4OWF2GFGUTZLLKZ7AOFQC3YU3ZBTX27DHTJ7VA, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:20.946706545 (223h34m47.647651441s) [noise=true , address=145.79.227.25:4617 , piece_id=WWFDJOPHNSEKYKY34GHYUOYQZLPPT63HHCWYOGHMGOCJAFESPRUQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: <nil> Nov 5 18:48:50.813745800 (223h35m17.514690715s) [noise=true , address=77.90.31.21:4878 , piece_id=2MFPRSSNKOHMJHHEZDEPZDT5YPZ3UQ5OKIHR6M5NASV7ZNEAIJQQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection; write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:10760->77.90.31.21:4878: use of closed network connection Nov 5 18:48:50.813791646 (223h35m17.514736561s) [noise=true , address=45.91.116.13:4155 , piece_id=S5YQHU342XFSBEKZACCRBMGHN7HRTGCMNYL4Y2G6TN7FGWVRPX7Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:40936->45.91.116.13:4155: use of closed network connection Nov 5 18:48:50.813873449 (223h35m17.514818365s) [noise=true , address=77.90.31.19:4842 , piece_id=UHEWZW4KZA52YONZW53LBYYR4ICMLLCZ6O2WE7FEHZZ3DVFSLL3Q, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection; write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:48040->77.90.31.19:4842: use of closed network connection Nov 5 18:48:50.814160668 (223h35m17.515105574s) [noise=true , address=45.91.116.7:4010 , piece_id=BQU33X23V3QGNX23ME3UGGAJ53JGJ7DAUXSERXB7CHPYUN6Q7QPQ, seg_pos={0 0}, upload=196703]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: context deadline exceeded; context deadline exceeded Nov 5 18:48:50.814198479 (223h35m17.515143394s) [seg_pos={0 0}, upload=196703]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Nov 5 18:48:50.829782465 (223h35m17.53072738s) [upload=196703]: Done uploading segments... Nov 5 18:48:50.829803484 (223h35m17.5307484s) [upload=196703]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.017540224s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 113.852839ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:45:53 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 113.891321ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 116.172548ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:45:07 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 116.18981ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 117.482385ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:44:26 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 117.504016ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 114.647839ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:43:46 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 114.66498ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 112.602294ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:43:11 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 112.633552ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 123.637759ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:41:57 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 123.661073ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 136.078121ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:40:48 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 136.104581ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 119.341512ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:40:03 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 119.358654ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 117.206438ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:38:50 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 117.225364ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 126.179767ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:38:18 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 126.197499ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 120.161209ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:37:22 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 120.179674ms edge linksharing bgp eu1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 121.595759ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-11-05 18:36:44 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 121.611929ms edge linksharing bgp eu1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)