Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 865.234037ms FAIL (2025-09-18 07:01:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 865.258813ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 433.346052ms FAIL (2025-09-18 07:00:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 433.357141ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.357645567s FAIL (2025-09-18 07:00:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 1.357669754s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 597.7334ms FAIL (2025-09-18 07:00:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 597.884914ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 759.515404ms FAIL (2025-09-18 07:00:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 759.546231ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 397.185456ms FAIL (2025-09-18 06:59:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 397.204672ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 501.717345ms FAIL (2025-09-18 06:59:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 501.74693ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 489.497685ms FAIL (2025-09-18 06:58:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 489.511561ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 369.807392ms FAIL (2025-09-18 06:58:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 369.818392ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 632.208483ms FAIL (2025-09-18 06:58:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 632.235194ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 602.179156ms FAIL (2025-09-18 06:57:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 602.20227ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 573.233639ms FAIL (2025-09-18 06:57:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 573.260228ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 447.70931ms FAIL (2025-09-18 06:56:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 447.727032ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 444.952978ms FAIL (2025-09-18 06:56:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 444.974639ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 576.194715ms FAIL (2025-09-18 06:55:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 576.215885ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 485.982969ms FAIL (2025-09-18 06:55:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 486.005852ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 461.09115ms FAIL (2025-09-18 06:54:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 461.117799ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 366.679143ms FAIL (2025-09-18 06:54:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 366.700453ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 494.315465ms FAIL (2025-09-18 06:54:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 494.33978ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 715.685626ms FAIL (2025-09-18 06:53:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 715.706435ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 461.268494ms FAIL (2025-09-18 06:53:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 461.290846ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 670.222865ms FAIL (2025-09-18 06:53:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 670.249184ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 384.21227ms FAIL (2025-09-18 06:52:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 384.238158ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 453.700253ms FAIL (2025-09-18 06:52:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 453.725169ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 372.344743ms FAIL (2025-09-18 06:52:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 372.366264ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 387.684497ms FAIL (2025-09-18 06:52:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 387.700929ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 562.764346ms FAIL (2025-09-18 06:51:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 562.783531ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 407.150643ms FAIL (2025-09-18 06:51:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 407.161634ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 469.168535ms FAIL (2025-09-18 06:50:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 469.199103ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 660.258747ms FAIL (2025-09-18 06:50:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 660.28178ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 565.889638ms FAIL (2025-09-18 06:50:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 565.914324ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 605.677156ms FAIL (2025-09-18 06:49:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 605.698998ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 419.354473ms FAIL (2025-09-18 06:49:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 419.367929ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 455.162035ms FAIL (2025-09-18 06:49:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 455.207682ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 336.713594ms FAIL (2025-09-18 06:48:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 336.726107ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 765.135744ms FAIL (2025-09-18 06:48:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 765.157685ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 421.326856ms FAIL (2025-09-18 06:48:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 421.351332ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 424.358293ms FAIL (2025-09-18 06:47:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 424.373061ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 501.998443ms FAIL (2025-09-18 06:47:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 502.026425ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 461.290703ms FAIL (2025-09-18 06:46:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 461.309739ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 375.465717ms FAIL (2025-09-18 06:46:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 375.486487ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 423.307292ms FAIL (2025-09-18 06:46:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 423.32758ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 418.387063ms FAIL (2025-09-18 06:45:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 418.403443ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 588.723724ms FAIL (2025-09-18 06:45:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 588.749433ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 672.48927ms FAIL (2025-09-18 06:45:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 672.552888ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 399.794611ms FAIL (2025-09-18 06:44:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 399.814068ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 493.406919ms FAIL (2025-09-18 06:44:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 493.433027ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 387.722379ms FAIL (2025-09-18 06:44:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== em: pb.BatchRequestItem_SegmentBegin Sep 18 06:21:00.406634509 (472h12m35.759419607s) [seg_pos={0 0}, upload=415651]: Begin upload segment... Sep 18 06:21:00.406674804 (472h12m35.759459903s) [seg_pos={0 0}, upload=415651]: Done begin upload segment. Sep 18 06:21:00.406696906 (472h12m35.759482014s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.406707956 (472h12m35.759493085s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407029581 (472h12m35.759814689s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407042856 (472h12m35.759827954s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407290631 (472h12m35.760075729s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407335154 (472h12m35.760120262s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407534508 (472h12m35.760319616s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407643693 (472h12m35.760428791s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407876960 (472h12m35.760662088s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.407976797 (472h12m35.760761896s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408191752 (472h12m35.760976849s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408246144 (472h12m35.761031242s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408443995 (472h12m35.761229103s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408750219 (472h12m35.761535317s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.408995018 (472h12m35.761780116s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.409217326 (472h12m35.762002424s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Uploading piece... Sep 18 06:21:00.482276928 (472h12m35.835062036s) [upload=415651]: Next returned nil segment Sep 18 06:21:00.482298939 (472h12m35.835084047s) [upload=415651]: Waiting for error group managing segments... Sep 18 06:21:00.494004563 (472h12m35.846789671s) [noise=true , address=145.79.227.2:4113 , piece_id=74WZD4XJZLFYOLI65IL2EXYRG55I55R4GFIVC3SKF2QKVSHZSQOQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494305999 (472h12m35.847091098s) [noise=true , address=145.79.227.15:4874 , piece_id=DZTMDVIJIYWHOUL4E4GGKSU6RZOTSIP5EQAD6ULRW5MPONZKHDFQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.494521493 (472h12m35.847306601s) [noise=true , address=145.79.227.5:4221 , piece_id=WP7YXHNELCGBWJMU5XNKVSJNKJUYBXRMZU6OL2SGH4ADW37KNHYA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:00.495017263 (472h12m35.847802361s) [noise=true , address=145.79.227.16:4912 , piece_id=TWSWDK7RCN7RAFU2M4R2I4RMKWDHVAV242MGIBGUOZ5575SYV64A, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:29.335357246 (472h13m4.688142354s) [noise=true , address=45.91.116.4:4937 , piece_id=NHZZ4RTJPLIRGOEZE35HMJM36UQNKZ7BBXANF3VOLR2L4NZIGOEA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.078562165 (472h13m5.431347273s) [noise=true , address=45.91.116.14:4190 , piece_id=LAUZ7JI5CKTVCR5FYELFTVROKQU4AAW7KQEFYNKTS6OEVXQVIY5Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: <nil> Sep 18 06:21:30.373203149 (472h13m5.725988288s) [noise=true , address=77.90.31.13:4628 , piece_id=5QY7TP5VCJUYHZ6INO5Y5UIXV6VS4OKQ3DAYKUWKLD4KYL2FZDGQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373316822 (472h13m5.72610196s) [noise=true , address=77.90.31.12:4590 , piece_id=F3VBHMHF7RZEDSSOTW42TFMUD77NZW2LLUHEG5NQ4DOBIQG2FAXA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, address:77.90.31.12:4590): protocol: read tcp 5.161.89.252:17500->77.90.31.12:4590: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373407473 (472h13m5.726192611s) [noise=true , address=45.91.116.8:4047 , piece_id=HNMEIOAEK45NOSAJ574VIRGWILXHXSZY3VNTGPGJKKR77MAO757Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:48174->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373436468 (472h13m5.726221596s) [noise=true , address=45.91.116.9:4262 , piece_id=ZT3MZQ6JJETFBP2UEPIOHNN6UA7HFRDYW6LTRAKRHA4B2YT42ILA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373493525 (472h13m5.726278653s) [noise=true , address=45.91.116.10:4082 , piece_id=DQ7BH6P3SXLXAIDWKUJ7ZLMPVU4QDDJ47U2EKVKRIRFHNZNC6NIQ, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373503924 (472h13m5.726289053s) [noise=true , address=45.91.116.6:4975 , piece_id=LGJYHBNENVYBYOJNZMR67ZKVF663BPVTDRKFRCHOL2RAVZG3NPCA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373594234 (472h13m5.726379362s) [noise=true , address=77.90.31.19:4841 , piece_id=3CKF4GT3D3RQ3O4KHADYF2FPPKKFISRV447YQM3YWYIKIY6LQC6Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373642995 (472h13m5.726428123s) [noise=true , address=45.91.116.11:4119 , piece_id=H3DPJDEBQZTTTFUJEPUMUXTUK3NRRXU644JFA6SKXRUSJ6PRXBDA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: read tcp 5.161.89.252:46646->45.91.116.11:4119: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373655599 (472h13m5.726440737s) [noise=true , address=77.90.31.10:4517 , piece_id=KWZ7E5PTD2JYFFDA72AZOHSXL4ICSD2E2NQR3DPALIXOWQAKBPZA, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 18 06:21:30.373716553 (472h13m5.726501681s) [noise=true , address=45.91.116.5:4297 , piece_id=TR7NFAX6GDSFPVZZHTNLDO4SY56IE7JFAS4FODQ35KPO2FZXEC3Q, seg_pos={0 0}, upload=415651]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: read tcp 5.161.89.252:12364->45.91.116.5:4297: use of closed network connection; context deadline exceeded Sep 18 06:21:30.373748693 (472h13m5.726533832s) [seg_pos={0 0}, upload=415651]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 18 06:21:30.388943886 (472h13m5.741729014s) [upload=415651]: Done uploading segments... Sep 18 06:21:30.388973221 (472h13m5.741758349s) [upload=415651]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration:* 387.743398ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 562.569389ms FAIL (2025-09-18 06:44:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 562.622849ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 468.450412ms FAIL (2025-09-18 06:43:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 468.463827ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)