Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 450.625944ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:45:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 450.646313ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 420.594771ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:44:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 420.610259ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 410.297742ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:44:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 410.316797ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 448.971844ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:43:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 448.997813ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 401.339784ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:42:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 401.357278ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 409.90116ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:42:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 409.95368ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 440.559959ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:41:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 440.576692ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 418.454552ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:41:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 418.473818ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 436.768366ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:40:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 436.817387ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 456.626094ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:39:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 456.645931ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 521.656429ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:38:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 521.682326ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 495.53181ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:38:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 495.55356ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 405.298694ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:37:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 405.321555ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 389.658302ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:36:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 389.683168ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 471.293408ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:35:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 471.31583ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 398.98737ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:34:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 399.018308ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 458.46952ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:33:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 458.48597ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 390.359481ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:32:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 390.382594ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 430.969174ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:31:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 430.992556ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 433.123471ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:30:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 433.14363ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 375.135597ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:29:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 375.156556ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 401.551918ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:28:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 401.598123ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 421.728934ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:27:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 421.744724ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 401.348516ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:26:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 401.379124ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 405.015741ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:25:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 405.038653ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 398.30681ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:24:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 398.328231ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 454.571158ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:24:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 454.597367ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 479.915654ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:23:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 479.944458ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 397.6492ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:22:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 397.668065ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 394.1764ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:22:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 394.200125ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 359.772344ms trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:21:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 359.79182ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.022925269s trace: https://jaeger.dev.storj.io/trace/145eaa01a5f69010 FAIL (2026-02-05 01:20:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Feb 5 01:20:27.725290604 (489h24m5.907735604s) [upload=430282]: Starting upload Feb 5 01:20:27.725401741 (489h24m5.907846731s) [upload=430282]: Done starting upload Feb 5 01:20:27.725551751 (489h24m5.907996752s) [upload=430282]: Uploading segments... Feb 5 01:20:27.725761734 (489h24m5.908206735s) [upload=430282]: Got next segment. Inline: false Feb 5 01:20:27.725830965 (489h24m5.908275954s) [upload=430282]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 5 01:20:27.725836054 (489h24m5.908281054s) [upload=430282]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 5 01:20:27.746490255 (489h24m5.928935235s) [seg_pos={0 0}, upload=430282]: Begin upload segment... Feb 5 01:20:27.746528506 (489h24m5.928973486s) [seg_pos={0 0}, upload=430282]: Done begin upload segment. Feb 5 01:20:27.746559394 (489h24m5.929004375s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746582106 (489h24m5.929027076s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.746902084 (489h24m5.929347054s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747185675 (489h24m5.929630655s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747447925 (489h24m5.929892894s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747710916 (489h24m5.930155896s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.747991050 (489h24m5.93043602s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748271905 (489h24m5.930716885s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748564251 (489h24m5.931009231s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.748853552 (489h24m5.931298521s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.750065517 (489h24m5.932510497s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.751123383 (489h24m5.933568353s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.752191771 (489h24m5.934636741s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.753215824 (489h24m5.935660804s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.754238816 (489h24m5.936683797s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.755442375 (489h24m5.937887355s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Uploading piece... Feb 5 01:20:27.823680799 (489h24m6.006125769s) [upload=430282]: Next returned nil segment Feb 5 01:20:27.823690156 (489h24m6.006135126s) [upload=430282]: Waiting for error group managing segments... Feb 5 01:20:27.831139439 (489h24m6.01358442s) [noise=true , address=45.91.116.11:4152 , piece_id=DID2YTE2RIJS3TPTTVFB5XNSG6FPCRUUECQJ6HXGIX7YCZMAMPQA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831492739 (489h24m6.013937719s) [noise=true , address=45.91.116.11:4120 , piece_id=GJPVGJYHIEC53O6KHPYDBOQ5BJG5X7YINK6TAFT2VD7HJOEF5ZYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.831885924 (489h24m6.014330904s) [noise=true , address=45.91.116.5:4300 , piece_id=6RGY6UY5TEGOJFMVT6YOQNDEVWMQFQ7RS3WVW45AYHJ4PRKKA53A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832032157 (489h24m6.014477137s) [noise=true , address=79.127.219.46:4889 , piece_id=ZUYQSCADY5OFANCA4WKZDZMPTBYTK5KEHDCAZCGVW4G6AAFDSTYQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832341746 (489h24m6.014786716s) [noise=true , address=79.127.219.41:4925 , piece_id=IPHJPSD3CCDDNJ2BNPF3FOB3Q7VLTHVBNUKO5OB246SKBJZ2PBHQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832654280 (489h24m6.01509925s) [noise=true , address=45.91.116.12:4225 , piece_id=TCHGRLU4GXPTXH2Y3LD6L4LL7R3YTRZJWS2T5FIY3SB3A7K2WKMA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.832661003 (489h24m6.015105983s) [noise=true , address=45.91.116.14:4224 , piece_id=AHNHLLQ3ZQMU7VGZF2JMGKFRBLQ6KDDHQXUEW2DPZEMEGCBER5IA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833103049 (489h24m6.015548029s) [noise=true , address=145.79.227.8:4329 , piece_id=ZKMHCRRUUWH7AL56P4FGT5HP4BMXXYMYCZH357ZMBBKIQN3NQ2TQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833259240 (489h24m6.015704211s) [noise=true , address=145.79.227.19:4079 , piece_id=PR4D3RP2O6NZWZ6JBFNSWHW6OKSS2ODBDQKL6HA3HNLB5AVXCRTQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:27.833466969 (489h24m6.015911949s) [noise=true , address=79.127.219.38:4818 , piece_id=VL4PG5OPXYAGRL3OUB4F4ZV5SQL55OZQIFH4WCFIDBAF33E6DFYA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:29.077042539 (489h24m7.259487539s) [noise=true , address=145.79.227.36:4518 , piece_id=FXVEUMUBO3BXHHHCOQMCRMAJZJFBFNT7EAEWWJ34TK3V6CDZVT5A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: <nil> Feb 5 01:20:57.705588585 (489h24m35.888033555s) [noise=true , address=77.90.31.13:4627 , piece_id=F4BB2XDYPDQYF45AHLQDHWLS2PDCTR4R3HCLTMRNCXSAQV2F4ACQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: rpc: dial tcp 77.90.31.13:4627: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.705733196 (489h24m35.888178276s) [noise=true , address=77.90.31.12:4590 , piece_id=AW6BS5O7BQTSRLHD5NJDFKYYPXFAVUSCDXAVSHUBQL3ZEGJNEUIQ, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:14630->77.90.31.12:4590: use of closed network connection Feb 5 01:20:57.705919113 (489h24m35.888364083s) [noise=true , address=77.90.31.16:4735 , piece_id=T5ZK3XMZ2RKZAKEQSAO3RFQOOH6PQLHVCHLPIPJPEHFB3QONJR4A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:47824->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706435347 (489h24m35.888880307s) [noise=true , address=77.90.31.19:4841 , piece_id=RFEXJVR4QFCVVEPGNWL2K4GX3RRXFDCHA4UWVDAEBYXFV5AKNHPA, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: read tcp 5.161.89.252:29474->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706696186 (489h24m35.889141155s) [noise=true , address=77.90.31.14:4664 , piece_id=3FT3N47EGNZTIQJDYSN6AOEKEOXBZD43YG2AA6MV2FUIGPZU5A3A, seg_pos={0 0}, upload=430282]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: read tcp 5.161.89.252:56630->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 5 01:20:57.706722234 (489h24m35.889167204s) [seg_pos={0 0}, upload=430282]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Feb 5 01:20:57.726510627 (489h24m35.908955626s) [upload=430282]: Done uploading segments... Feb 5 01:20:57.726544360 (489h24m35.90898936s) [upload=430282]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.022942901s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 278.586945ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:18:22 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 278.609808ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 276.408077ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:17:59 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 276.424869ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 738.424797ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:17:04 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 738.442761ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 778.669349ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:16:37 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 778.684567ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 268.472172ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:16:10 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 268.488912ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 273.822346ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:15:19 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 273.8411ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 278.863973ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:14:05 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 278.880985ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 284.013712ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:12:51 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 284.027337ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 266.698535ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:12:01 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 266.718112ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 282.139933ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:11:01 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 282.158618ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 273.16239ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:10:43 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 273.200883ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 280.87938ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:09:45 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 280.890951ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 272.660198ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:08:45 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 272.678793ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 279.491576ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:07:54 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 279.511383ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 270.410531ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:07:35 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 270.427433ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 269.816127ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:06:36 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 269.840722ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 277.162324ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:05:46 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 277.18158ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 748.205729ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/8c53f73aa3580b8 FAIL (2026-02-04 23:05:17 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 748.221349ms edge linksharing bgp ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)