Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 596.301652ms FAIL (2025-09-19 04:34:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 596.328851ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 689.971963ms FAIL (2025-09-19 04:33:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 690.012629ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 764.780881ms FAIL (2025-09-19 04:33:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 764.796441ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 673.856881ms FAIL (2025-09-19 04:33:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 673.87217ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 1.1340152s FAIL (2025-09-19 04:33:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.134037722s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 1.0657662s FAIL (2025-09-19 04:32:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.065783491s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 562.516156ms FAIL (2025-09-19 04:32:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 562.537545ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 423.709773ms FAIL (2025-09-19 04:32:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 423.729119ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 653.800826ms FAIL (2025-09-19 04:31:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 653.826183ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 432.660129ms FAIL (2025-09-19 04:31:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 432.686719ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 851.069308ms FAIL (2025-09-19 04:31:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 851.091941ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 609.869596ms FAIL (2025-09-19 04:30:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 609.881028ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 459.622665ms FAIL (2025-09-19 04:30:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 459.640779ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 455.114525ms FAIL (2025-09-19 04:30:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 455.13313ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 446.987175ms FAIL (2025-09-19 04:30:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 447.003826ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 614.431868ms FAIL (2025-09-19 04:29:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 614.457866ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 1.100504486s FAIL (2025-09-19 04:29:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.100525135s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 489.477789ms FAIL (2025-09-19 04:29:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 489.498788ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......XX...................................................] duration: 632.345353ms FAIL (2025-09-19 04:29:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 632.37014ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 481.658658ms FAIL (2025-09-19 04:28:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 481.678295ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 462.364291ms FAIL (2025-09-19 04:28:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 462.380581ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......XX...................................................] duration: 573.05906ms FAIL (2025-09-19 04:28:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 573.100469ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 809.24404ms FAIL (2025-09-19 04:28:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 809.266873ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 603.431323ms FAIL (2025-09-19 04:28:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 603.451401ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 459.312753ms FAIL (2025-09-19 04:27:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 459.33797ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 432.147909ms FAIL (2025-09-19 04:27:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 432.167355ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 630.288412ms FAIL (2025-09-19 04:27:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 630.318688ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 731.432292ms FAIL (2025-09-19 04:27:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 731.458261ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 664.728431ms FAIL (2025-09-19 04:26:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 664.753027ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 656.48473ms FAIL (2025-09-19 04:26:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 656.515939ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 481.012966ms FAIL (2025-09-19 04:26:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 481.033305ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 486.238129ms FAIL (2025-09-19 04:25:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 486.265579ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 668.232665ms FAIL (2025-09-19 04:25:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 668.248325ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 568.977552ms FAIL (2025-09-19 04:25:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 569.004431ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 529.841352ms FAIL (2025-09-19 04:25:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 529.869825ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 767.040081ms FAIL (2025-09-19 04:25:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 767.093281ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............XX............................................] duration: 578.824219ms FAIL (2025-09-19 04:24:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 578.854287ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 490.641042ms FAIL (2025-09-19 04:24:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 490.661561ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............XX...........................................] duration: 456.018331ms FAIL (2025-09-19 04:24:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 456.063877ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 761.951922ms FAIL (2025-09-19 04:23:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 761.970106ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 460.258387ms FAIL (2025-09-19 04:23:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 460.275649ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 463.212882ms FAIL (2025-09-19 04:23:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 463.24905ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 484.764614ms FAIL (2025-09-19 04:22:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 484.786716ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 973.131117ms FAIL (2025-09-19 04:22:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 973.144162ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 684.897619ms FAIL (2025-09-19 04:22:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 684.911224ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..............XX............................................] duration: 807.389037ms FAIL (2025-09-19 04:22:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 807.409756ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 467.142636ms FAIL (2025-09-19 04:21:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 1) ======LOGS====== se=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834166565 (493h38m13.186951693s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834512584 (493h38m13.187297722s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.834858423 (493h38m13.187643552s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835302517 (493h38m13.188087644s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.835662332 (493h38m13.18844747s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836053856 (493h38m13.188838985s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.836809615 (493h38m13.189594743s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Uploading piece... Sep 19 03:46:37.932389968 (493h38m13.285175097s) [upload=434601]: Next returned nil segment Sep 19 03:46:37.932406981 (493h38m13.285192108s) [upload=434601]: Waiting for error group managing segments... Sep 19 03:46:37.941308805 (493h38m13.294093933s) [noise=true , address=45.91.116.6:4005 , piece_id=FPN2HHVULK3NMPMHW2APFAQFQS5RQW6XUWTT3T3PVNZPLS63FKVQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: <nil> Sep 19 03:47:37.792497637 (493h39m13.145282765s) [noise=true , address=145.79.227.9:4367 , piece_id=JEAJHYPYERBXBTI5S42CGI6XCMSK2Y2S5Q3KMCEZU4AOLF3R3QZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12CMjNpf3aMdqEYea6xSrAWGoEMzfy4SbEjXywZN7JPRCbvDpK6, address:145.79.227.9:4367): protocol: rpc: dial tcp 145.79.227.9:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792568520 (493h39m13.145353647s) [noise=true , address=145.79.227.33:4880 , piece_id=FHXX7J7LFBZPAWBPRLYMKWUSGSHQT4QXKIE6BKE466IYXYH6VBJQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:145.79.227.33:4880): protocol: rpc: dial tcp 145.79.227.33:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792618243 (493h39m13.145403371s) [noise=true , address=145.79.227.51:4432 , piece_id=QBEDUOSEJEIEIMTUJVH6BUK7DLI774ZK2GPDVOE3MUF55TF67WIQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12JzGBbG1khQNggJUXPGbFYejEYjBvYc313aYkiXsj2WDMYCECK, address:145.79.227.51:4432): protocol: rpc: dial tcp 145.79.227.51:4432: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792665091 (493h39m13.145450219s) [noise=true , address=145.79.227.28:4748 , piece_id=WCKFH3V33EHCIQPAVPITRH2JCV34ZKAHIQVIC45YXRHL7KDZ36PA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9, address:145.79.227.28:4748): protocol: rpc: dial tcp 145.79.227.28:4748: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792694486 (493h39m13.145479614s) [noise=true , address=145.79.227.48:4315 , piece_id=Y47PNHUYWPUBPZ7ZICVE4PXDQVTANIQIVPF6KPXJ4YQ4HCMZOQMA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:145.79.227.48:4315): protocol: rpc: dial tcp 145.79.227.48:4315: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792715826 (493h39m13.145500954s) [noise=true , address=145.79.227.11:4749 , piece_id=RBST3GZPH44IIARTR642MDFVUBSQJPTQHVC2Z4I2WG6UFCYOFVLA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12sRotj46WjNNsVciJDRvSEbrj8XHwshKRmMneedu6UH4egmZDm, address:145.79.227.11:4749): protocol: rpc: dial tcp 145.79.227.11:4749: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792758816 (493h39m13.145543945s) [noise=true , address=145.79.227.52:4459 , piece_id=JYYV4UGEOCDGFQXPV6FRMREY5UXLQG4HE6WCX4GGXBGXE2NRBQBA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N, address:145.79.227.52:4459): protocol: rpc: dial tcp 145.79.227.52:4459: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792784164 (493h39m13.145569292s) [noise=true , address=145.79.227.34:4939 , piece_id=OA5WV3ZHK5PXJIFFCX26SB57X4YLYUBRRB72ZGDW3AW2AXIAHMXA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792807187 (493h39m13.145592325s) [noise=true , address=145.79.227.6:4269 , piece_id=QJL574JV743QD7532CE4XUDOBVM3XNEBH5ZNMWR7WQVXTDZK2ZFA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12V8v5nzyyouSqndATi4fRJUC6HgFbhguBjnmwpki48zdRBTcgC, address:145.79.227.6:4269): protocol: rpc: dial tcp 145.79.227.6:4269: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792855408 (493h39m13.145640546s) [noise=true , address=145.79.227.47:4275 , piece_id=MIMODU3HUDKIHR7YH75WE6L2HBIREXRVMIMBHS2TY3ENFNPZGKOA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3, address:145.79.227.47:4275): protocol: rpc: dial tcp 145.79.227.47:4275: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792863223 (493h39m13.14564835s) [noise=true , address=145.79.227.49:4343 , piece_id=ZPOCAIF2IUSYQWFJC7ZLS33J6ZORS3BVQ5SJQRAV3IR6H2HNTGZQ, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:16EsEMRW53sjKVag2WpSDGLhELyE2bSXyW4aAurCvDFKRNkXuf, address:145.79.227.49:4343): protocol: rpc: dial tcp 145.79.227.49:4343: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792899891 (493h39m13.145685019s) [noise=true , address=145.79.227.48:4333 , piece_id=WGN7MDRHZXRYGUW6OIHDZKBIY2ARYOUDQWAVG5QK2O4RGBAZYE3A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12K7U6NXcB6SFBtQFrG7DXt2skACr3u5DX2QsrnToi8EKywS9TN, address:145.79.227.48:4333): protocol: rpc: dial tcp 145.79.227.48:4333: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.792942352 (493h39m13.14572749s) [noise=true , address=145.79.227.14:4855 , piece_id=IASURINQII2IVF2N3YH5M4UD6KLHWYTGEDSJIX3T67UTAEDJATTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh, address:145.79.227.14:4855): protocol: rpc: dial tcp 145.79.227.14:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793009478 (493h39m13.145794616s) [noise=true , address=145.79.227.46:4604 , piece_id=ZJGQC6RO7I5L4Q4NJ3QOGU7C2WKWLEIHCVS7NWPH2ZYN2CTLRVTA, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:129d1v3mjqB3FHC2VmbY9Sih6C5fRDrV3kGLiv9NfkDc7JovXjy, address:145.79.227.46:4604): protocol: rpc: dial tcp 145.79.227.46:4604: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793079178 (493h39m13.145864307s) [noise=true , address=145.79.227.44:4198 , piece_id=F6NWR5CAWXASOU5TOJZVZQUBYV2ZDBPV3GIRRO3UV2YTEVB5IV4Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12YxL4YR6mNE536w1SnBrMUZHiaRTuU68Zjg9LBvRURVx5s5HWL, address:145.79.227.44:4198): protocol: rpc: dial tcp 145.79.227.44:4198: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793090990 (493h39m13.145876119s) [noise=true , address=145.79.227.16:4924 , piece_id=6TBGX463OPKYFAIX3UHQQGBGN3ZCGP5GRFQNFRIA37TGVQXL3T7A, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12mXBUcQEzsNgQ1YQzU9ezpZigBEHHhPttBac2G1Xrjks3SwM6z, address:145.79.227.16:4924): protocol: rpc: dial tcp 145.79.227.16:4924: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793119764 (493h39m13.145904903s) [noise=true , address=145.79.227.12:4794 , piece_id=3HSP6ZPKQ2B4VGC5HWVXJCNEWFKHF3JF7S3GSDWYSFMB7EN6OP2Q, seg_pos={0 0}, upload=434601]: Done uploading piece. err: ecclient: upload failed (node:12ctLLD5skk4t5i3BFYgoTmuZ2aqsX23wDGDMnKriQ7U2KXyPAo, address:145.79.227.12:4794): protocol: rpc: dial tcp 145.79.227.12:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:47:37.793191058 (493h39m13.145976187s) [seg_pos={0 0}, upload=434601]: Done waiting for segment. successful: 1 optimal: 14 errs: <nil> Sep 19 03:47:37.812736236 (493h39m13.165521373s) [upload=434601]: Done uploading segments... Sep 19 03:47:37.812751975 (493h39m13.165537103s) [upload=434601]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 1) Duration: 467.163064ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 622.169264ms FAIL (2025-09-19 04:21:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 622.199691ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...............XX...........................................] duration: 621.65346ms FAIL (2025-09-19 04:21:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 621.685249ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 509.642838ms FAIL (2025-09-19 04:20:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 03:48:00.933461584 (493h39m36.286246681s) [upload=434622]: Starting upload Sep 19 03:48:00.933516056 (493h39m36.286301164s) [upload=434622]: Done starting upload Sep 19 03:48:00.933551392 (493h39m36.2863365s) [upload=434622]: Uploading segments... Sep 19 03:48:00.933728905 (493h39m36.286514013s) [upload=434622]: Got next segment. Inline: false Sep 19 03:48:00.933755434 (493h39m36.286540542s) [upload=434622]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 03:48:00.933759142 (493h39m36.286544239s) [upload=434622]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 03:48:00.954682055 (493h39m36.307467153s) [seg_pos={0 0}, upload=434622]: Begin upload segment... Sep 19 03:48:00.954710388 (493h39m36.307495486s) [seg_pos={0 0}, upload=434622]: Done begin upload segment. Sep 19 03:48:00.954729594 (493h39m36.307514692s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.954750713 (493h39m36.307535821s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955003377 (493h39m36.307788475s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955011953 (493h39m36.307797061s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955242116 (493h39m36.308027214s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955251223 (493h39m36.308036331s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955467118 (493h39m36.308252216s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955501051 (493h39m36.308286149s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955682612 (493h39m36.30846772s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955777831 (493h39m36.308562939s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.955943541 (493h39m36.30872864s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956025516 (493h39m36.308810614s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956172963 (493h39m36.30895806s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956253013 (493h39m36.309038111s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956381554 (493h39m36.309166662s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:00.956586508 (493h39m36.309371616s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Uploading piece... Sep 19 03:48:01.029667009 (493h39m36.382452118s) [upload=434622]: Next returned nil segment Sep 19 03:48:01.029678050 (493h39m36.382463148s) [upload=434622]: Waiting for error group managing segments... Sep 19 03:48:01.037364103 (493h39m36.390149211s) [noise=true , address=45.91.116.8:4045 , piece_id=5RDISVVYQIS4WRBO6FXO5H4II7KHK7OAXHEANNESEQFUT6QS53TA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.037923674 (493h39m36.390708782s) [noise=true , address=45.91.116.14:4189 , piece_id=HNITJYKII5ZV6VZC6SZHGDSXOVK37EYZNVM3LAAWGLIBKADHPGSA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038134359 (493h39m36.390919457s) [noise=true , address=45.91.116.12:4226 , piece_id=RDXJC2OPCL6X6LWUONQEEAFSEQR7JDTKLLYZF5SCIWADLRPUPBHQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038335066 (493h39m36.391120174s) [noise=true , address=45.91.116.5:4298 , piece_id=L2BCL33GQLNR7YLDSOD57VZM44IDJPVH3HRCNGKWGBKCCAWUWO3Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038509183 (493h39m36.391294291s) [noise=true , address=45.91.116.7:4010 , piece_id=UQYH3CZPEIFWIB47R6T4GTA7X44QUW44GQFEK6USUR4VHIDGSTUQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038670696 (493h39m36.391455794s) [noise=true , address=45.91.116.4:4938 , piece_id=UIQA36SI7LK5YUNERZUNNBNDWOMXBVITQLGXKHERCHAEXY2H3PMA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.038876883 (493h39m36.391662011s) [noise=true , address=45.91.116.12:4225 , piece_id=7IZ4L2FBMVV74DQBGZFHRQTHXF3MVXSJVY327WVCR535VU7K55CA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039048966 (493h39m36.391834074s) [noise=true , address=77.90.31.15:4699 , piece_id=GYL4KKHBUEQ4N7LU76E4E7VO4NBX3YLVDPNBRJE7JFQRIKWUK63A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039316086 (493h39m36.392101194s) [noise=true , address=77.90.31.16:4734 , piece_id=O3DMURO4DTYVW2LLTQANZWWNNNN7574H5RR44SCTT2TEPQL7J7AQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.039428689 (493h39m36.392213797s) [noise=true , address=77.90.31.17:4771 , piece_id=5QZY5A5DAGAVMPDCCME7H5ADUW5NPQPIDHFKYNJCQQUXW6IYP47Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040418256 (493h39m36.393203364s) [noise=true , address=77.90.31.10:4518 , piece_id=EYYKSXIL6VASCZTOPSVFCGBN36IBU3NKB5ULQVBQNDROKXFQLUQQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:01.040450436 (493h39m36.393235544s) [noise=true , address=77.90.31.14:4661 , piece_id=4TKAWTHSRWUEUDQQYORRD6GNPCTE4AAXCBHTSH5G5YNRSVNTF76A, seg_pos={0 0}, upload=434622]: Done uploading piece. err: <nil> Sep 19 03:48:30.917577103 (493h40m6.270362211s) [noise=true , address=145.79.227.19:4077 , piece_id=SEEBMIH6GOENV2LISFNPM7VGYSSH34Z6OSKNDJYRV73LZREB6OCA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: rpc: dial tcp 145.79.227.19:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.917634510 (493h40m6.270419618s) [noise=true , address=145.79.227.17:4969 , piece_id=ECNKGKCDZ2PD5NCE4SB4ESSIQEG7H4R4YUYLVUPUFKFIMGU5HRMQ, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:145.79.227.17:4969): protocol: rpc: dial tcp 145.79.227.17:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921816878 (493h40m6.274601976s) [noise=true , address=145.79.227.15:4873 , piece_id=3ICXRN4RV3XVHQWG5TWACJO5OHQZJPUYN32M57ZM65HDBUFIWT4Q, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:12XMLfJdbmhqnSjxRQ6DJwJowhxiqYzvi34JArdHpLzr8r2xnQ3, address:145.79.227.15:4873): protocol: rpc: dial tcp 145.79.227.15:4873: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.921937976 (493h40m6.274723074s) [noise=true , address=145.79.227.4:4186 , piece_id=MCEPMUZGVGCAKBYTLQH5XFQ3P5572CMHSETASKR6B2AL2SB5ENHA, seg_pos={0 0}, upload=434622]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:145.79.227.4:4186): protocol: rpc: dial tcp 145.79.227.4:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 03:48:30.922237047 (493h40m6.275022146s) [seg_pos={0 0}, upload=434622]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 03:48:31.048948681 (493h40m6.401733819s) [upload=434622]: Done uploading segments... Sep 19 03:48:31.048974840 (493h40m6.401759978s) [upload=434622]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 509.699304ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)