Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 19.360577819s FAIL (2025-10-06 23:06:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 19.360600752s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 568.880184ms FAIL (2025-10-06 23:06:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 568.89385ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X..........XX.........] duration: 515.945943ms FAIL (2025-10-06 23:06:45 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 515.973475ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 40.39069477s FAIL (2025-10-06 23:06:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 40.390712333s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X..........XX........] duration: 17.452219773s FAIL (2025-10-06 23:06:23 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 17.452238258s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000777978s FAIL (2025-10-06 23:06:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000793598s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 665.434266ms FAIL (2025-10-06 23:05:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 665.449474ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................................X..........XX.......] duration: 836.564685ms FAIL (2025-10-06 23:04:52 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 836.591856ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 752.753898ms FAIL (2025-10-06 23:04:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 752.795677ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X..........XX......] duration: 523.08985ms FAIL (2025-10-06 23:03:58 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 523.112932ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X..........XX.....] duration: 465.823922ms FAIL (2025-10-06 23:03:37 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 465.849119ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 653.07922ms FAIL (2025-10-06 23:02:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 653.124475ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X..........XX....] duration: 431.089736ms FAIL (2025-10-06 23:02:27 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 431.114152ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 840.15257ms FAIL (2025-10-06 23:02:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 840.181735ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 753.69787ms FAIL (2025-10-06 23:02:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 753.721894ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................................X..........XX...] duration: 552.249673ms FAIL (2025-10-06 23:01:28 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 552.271414ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 810.618232ms FAIL (2025-10-06 23:01:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 810.642527ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 3.558886462s FAIL (2025-10-06 23:00:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.558904286s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................................X..........XX..] duration: 565.165371ms FAIL (2025-10-06 23:00:33 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 565.194487ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 28.702923636s FAIL (2025-10-06 23:00:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 28.702950696s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................................X..........XX.] duration: 643.206131ms FAIL (2025-10-06 23:00:17 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 643.228994ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................................X..........XX] duration: 30.027623592s FAIL (2025-10-06 23:00:16 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Oct 6 22:59:46.884077630 (920h51m22.236862799s) [upload=810403]: Starting upload Oct 6 22:59:46.884205150 (920h51m22.236990278s) [upload=810403]: Done starting upload Oct 6 22:59:46.884295620 (920h51m22.237080757s) [upload=810403]: Uploading segments... Oct 6 22:59:46.884666616 (920h51m22.237451745s) [upload=810403]: Got next segment. Inline: false Oct 6 22:59:46.884743290 (920h51m22.237528418s) [upload=810403]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:46.884750263 (920h51m22.237535391s) [upload=810403]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:46.904611888 (920h51m22.257397016s) [seg_pos={0 0}, upload=810403]: Begin upload segment... Oct 6 22:59:46.904679865 (920h51m22.257464993s) [seg_pos={0 0}, upload=810403]: Done begin upload segment. Oct 6 22:59:46.904733516 (920h51m22.257518644s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.904830868 (920h51m22.257615997s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905315337 (920h51m22.258100455s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905607857 (920h51m22.258392994s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.905957051 (920h51m22.25874218s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906281602 (920h51m22.259066729s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906518225 (920h51m22.259303353s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.906917053 (920h51m22.259702181s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907043660 (920h51m22.259828789s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907597981 (920h51m22.260383109s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.907654597 (920h51m22.260439736s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908134929 (920h51m22.260920057s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908312362 (920h51m22.2610975s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.908796781 (920h51m22.26158191s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.911190102 (920h51m22.26397523s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:46.912062269 (920h51m22.264847397s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Uploading piece... Oct 6 22:59:47.008827498 (920h51m22.361612616s) [upload=810403]: Next returned nil segment Oct 6 22:59:47.008841855 (920h51m22.361626963s) [upload=810403]: Waiting for error group managing segments... Oct 6 22:59:47.016799659 (920h51m22.369584767s) [noise=true , address=145.79.227.11:4732 , piece_id=VXV7ZIPUBIMWUPGOPV47KCNAG6HMLWUSK3OK3KB6ZKHNEDNINYUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017144386 (920h51m22.369929494s) [noise=true , address=145.79.227.15:4873 , piece_id=M7AYCJ6RZHCSAFDCQ7Q5FOY6JT3CTCJX3KDVHB2S37EGO2LYWMOQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017266185 (920h51m22.370051283s) [noise=true , address=145.79.227.14:4839 , piece_id=DC2C7XPYH2NXHPPWSJAA5NN3X4JFLEKQCRTO4KT4PTQBM6GOQRWQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.017878554 (920h51m22.370663652s) [noise=true , address=145.79.227.11:4729 , piece_id=3WZERYWGJKFIL5G4YU4H6RKIQAORL4M7VPSVIDV64OCZOTB42X4Q, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018255210 (920h51m22.371040339s) [noise=true , address=145.79.227.17:4970 , piece_id=73Q54SKV7OWC6IPYPSBGVVL4CWIMIX6U3NPVRK43OW2Q452PJXYQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018400854 (920h51m22.371185962s) [noise=true , address=145.79.227.18:4006 , piece_id=CJJK5TQBA3K7I47PONSL3CJOWV7XVHJFSKO4SZZSAPVL546O3YYA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.018943813 (920h51m22.371728921s) [noise=true , address=145.79.227.14:4840 , piece_id=XJV5WADZHNE7FYURZSPNRCSQ7XIEPDSLONLWC3MRIVG4DN5QACCQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019253594 (920h51m22.372038682s) [noise=true , address=145.79.227.4:4185 , piece_id=2E3UKKXOXO3T4JIEDDWJQZCKQPYAO3SJJI6QVO5PYIY4FOV5C2QA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.019700543 (920h51m22.372506441s) [noise=true , address=145.79.227.12:4767 , piece_id=434JR5VGSKXMFPPVGBOP5Q3L5ROEBLRXOZW6LGURBEEYPS4GTUGQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.020258390 (920h51m22.373043498s) [noise=true , address=145.79.227.13:4804 , piece_id=CV2BI7EVHLI36A26ZFUOHBKCG32MFRLE5E75I5QFY22HDK54NS4A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 22:59:47.028448570 (920h51m22.381233678s) [noise=true , address=145.79.227.18:4005 , piece_id=NZEFMJLR54B7PLIKOABGWBD7LLUW77QUQOQACAO4CH7IGUL7FHIA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.612044719 (920h51m51.964829848s) [noise=true , address=45.91.116.13:4154 , piece_id=K4CLNNA2UMBAD5EF3LD5UYDN7YRJBGK5WXJPF7BQMTB6SR7LWRQA, seg_pos={0 0}, upload=810403]: Done uploading piece. err: <nil> Oct 6 23:00:16.863245986 (920h51m52.216031115s) [noise=true , address=77.90.31.17:4771 , piece_id=EOAZY4XGVWL2T7BSXKUBLNYFYY2RX4DZRQVMONIGHPQD7DXAIXUQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: write tcp 5.161.89.252:34364->77.90.31.17:4771: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863316969 (920h51m52.216102098s) [noise=true , address=45.91.116.13:4155 , piece_id=XMU42CCMKBPTP6M2J63OVXS6H4K3NAI3MO34DH7JAYJ5PWMZXA5A, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 5.161.89.252:38022->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863413090 (920h51m52.216198218s) [noise=true , address=77.90.31.16:4735 , piece_id=IY36QFNJOR56TF5ZJ7R4WW5FUTAQJQBBDMDH7N7NFTCE44TSPIHQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863464186 (920h51m52.216249313s) [noise=true , address=77.90.31.14:4663 , piece_id=QDFRXC5PBKH2TP6XTJMNYTCZDNKR35OYPSRKRIIA3QBPDQXEMCBQ, seg_pos={0 0}, upload=810403]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 23:00:16.863511255 (920h51m52.216296383s) [seg_pos={0 0}, upload=810403]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Oct 6 23:00:16.887849070 (920h51m52.240634208s) [upload=810403]: Done uploading segments... Oct 6 23:00:16.887877603 (920h51m52.240662731s) [upload=810403]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.027642798s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X..........X] duration: 30.015021512s FAIL (2025-10-06 22:59:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 9) ======LOGS====== Oct 6 22:59:16.779098759 (920h50m52.131883867s) [upload=810396]: Starting upload Oct 6 22:59:16.779150325 (920h50m52.131935424s) [upload=810396]: Done starting upload Oct 6 22:59:16.779185401 (920h50m52.131970499s) [upload=810396]: Uploading segments... Oct 6 22:59:16.779361913 (920h50m52.13214701s) [upload=810396]: Got next segment. Inline: false Oct 6 22:59:16.779389865 (920h50m52.132174963s) [upload=810396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:59:16.779393481 (920h50m52.132178589s) [upload=810396]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:59:16.799272864 (920h50m52.152057962s) [seg_pos={0 0}, upload=810396]: Begin upload segment... Oct 6 22:59:16.799307630 (920h50m52.152092727s) [seg_pos={0 0}, upload=810396]: Done begin upload segment. Oct 6 22:59:16.799329110 (920h50m52.152114208s) [noise=true , address=77.90.31.14:4661 , piece_id=IZNZSZLU2CEC5Z7IWZCC6C2I5OJQUTKV63C2L77ULYGQWYP7JCZQ, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.799333778 (920h50m52.152118887s) [noise=true , address=77.90.31.18:4806 , piece_id=XATR6BCBWWGW7MCRTINSXLRNJN4C2HTMMEYPMCVOV5CSR6WPCDJQ, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.799384494 (920h50m52.152169602s) [noise=true , address=145.79.227.4:4185 , piece_id=IGTBJPJETIEO7N5MWHBWR2AHX5UBMCCC3M7L2FRGJNLRIIKSRHXQ, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.799651504 (920h50m52.152436612s) [noise=true , address=77.90.31.16:4735 , piece_id=AZSWZFTS7NAJV4BSRW6XJBIDEVXVCSUCD3G62DCHGE32EQ3T7L6A, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.799657055 (920h50m52.152442153s) [noise=true , address=45.91.116.8:4047 , piece_id=2FXFKXPPYDGGCLDPCVPKQVAFDD7ZKBJJCBBL66QBYQICKLIQV6HA, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.799905352 (920h50m52.15269046s) [noise=true , address=145.79.227.14:4840 , piece_id=WW6BZUK3T2YZO2SIZE7DWKLEDUWRXJBPHWNTIW6QZ4LZLNCFLQKQ, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.799933565 (920h50m52.152718662s) [noise=true , address=145.79.227.17:4970 , piece_id=KRJUBYR5NNEIAZETSLXUUNGGJOG7F6DAFMABIBTAC4GG4VV4HXHQ, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.800142967 (920h50m52.152928066s) [noise=true , address=45.91.116.8:4045 , piece_id=LB7EGHVCMWTFSU2EB6MFWBTM5QOCVNIM5TVZOOZ6SJYG6RWZ4YRA, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.800183854 (920h50m52.152968952s) [noise=true , address=145.79.227.18:4006 , piece_id=UHV4RVGMV6QZU37MSJ7XH3YKPRLVP5TF5BASEB4OQFJGC4CZGEDA, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.800355807 (920h50m52.153140915s) [noise=true , address=77.90.31.13:4628 , piece_id=TOKVZ3BNEQRRJHT2CZC7QCUW6VRY4EMMYR3IR7KCHKKE64SFP3DA, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.800426249 (920h50m52.153211346s) [noise=true , address=77.90.31.19:4843 , piece_id=IYRHIQELU4RNWJWIZPROXGXZG4NOLRFMSJPCEOMV7VLSDGR2BDSQ, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.800580198 (920h50m52.153365296s) [noise=true , address=145.79.227.15:4874 , piece_id=DL2W64T6AKEYKRCZXVLNDYYKJYFFFURKB3SOOYUWXXA5O6H5UATA, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.800685916 (920h50m52.153471015s) [noise=true , address=145.79.227.3:4151 , piece_id=5CZNY2OD72VKDKXVPL7KQSYTVBNYQ3DVFTQTQ6ZWS2GHRCDER7DQ, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.800869130 (920h50m52.153654229s) [noise=true , address=145.79.227.13:4804 , piece_id=ERQP5US4PT6AUJUFR4P6KKO7L5AUSKDQIQM5KFZG5X7XQJMW6WGQ, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.800979637 (920h50m52.153764726s) [noise=true , address=145.79.227.5:4223 , piece_id=RI5OQLTLQ7M2P42ZNZR2NF7AH22AZJIL5V4XRIHRWXHJOFN7ZA5A, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.801222173 (920h50m52.154007261s) [noise=true , address=145.79.227.2:4115 , piece_id=GBTOZBJW7FYOXTOCJLUJTT5EIAVWV24IIY65HD3OUILFPBE5LG3A, seg_pos={0 0}, upload=810396]: Uploading piece... Oct 6 22:59:16.866701225 (920h50m52.219486323s) [upload=810396]: Next returned nil segment Oct 6 22:59:16.866711845 (920h50m52.219496953s) [upload=810396]: Waiting for error group managing segments... Oct 6 22:59:16.873591167 (920h50m52.226376275s) [noise=true , address=145.79.227.3:4151 , piece_id=5CZNY2OD72VKDKXVPL7KQSYTVBNYQ3DVFTQTQ6ZWS2GHRCDER7DQ, seg_pos={0 0}, upload=810396]: Done uploading piece. err: <nil> Oct 6 22:59:16.877295540 (920h50m52.230080648s) [noise=true , address=145.79.227.18:4006 , piece_id=UHV4RVGMV6QZU37MSJ7XH3YKPRLVP5TF5BASEB4OQFJGC4CZGEDA, seg_pos={0 0}, upload=810396]: Done uploading piece. err: <nil> Oct 6 22:59:16.878242147 (920h50m52.231027245s) [noise=true , address=145.79.227.17:4970 , piece_id=KRJUBYR5NNEIAZETSLXUUNGGJOG7F6DAFMABIBTAC4GG4VV4HXHQ, seg_pos={0 0}, upload=810396]: Done uploading piece. err: <nil> Oct 6 22:59:16.878690778 (920h50m52.231475886s) [noise=true , address=145.79.227.15:4874 , piece_id=DL2W64T6AKEYKRCZXVLNDYYKJYFFFURKB3SOOYUWXXA5O6H5UATA, seg_pos={0 0}, upload=810396]: Done uploading piece. err: <nil> Oct 6 22:59:16.879212508 (920h50m52.231997606s) [noise=true , address=145.79.227.2:4115 , piece_id=GBTOZBJW7FYOXTOCJLUJTT5EIAVWV24IIY65HD3OUILFPBE5LG3A, seg_pos={0 0}, upload=810396]: Done uploading piece. err: <nil> Oct 6 22:59:16.879353171 (920h50m52.23213827s) [noise=true , address=145.79.227.14:4840 , piece_id=WW6BZUK3T2YZO2SIZE7DWKLEDUWRXJBPHWNTIW6QZ4LZLNCFLQKQ, seg_pos={0 0}, upload=810396]: Done uploading piece. err: <nil> Oct 6 22:59:16.879532208 (920h50m52.232317316s) [noise=true , address=145.79.227.5:4223 , piece_id=RI5OQLTLQ7M2P42ZNZR2NF7AH22AZJIL5V4XRIHRWXHJOFN7ZA5A, seg_pos={0 0}, upload=810396]: Done uploading piece. err: <nil> Oct 6 22:59:16.879826130 (920h50m52.232611238s) [noise=true , address=145.79.227.4:4185 , piece_id=IGTBJPJETIEO7N5MWHBWR2AHX5UBMCCC3M7L2FRGJNLRIIKSRHXQ, seg_pos={0 0}, upload=810396]: Done uploading piece. err: <nil> Oct 6 22:59:16.880212895 (920h50m52.232998003s) [noise=true , address=145.79.227.13:4804 , piece_id=ERQP5US4PT6AUJUFR4P6KKO7L5AUSKDQIQM5KFZG5X7XQJMW6WGQ, seg_pos={0 0}, upload=810396]: Done uploading piece. err: <nil> Oct 6 22:59:46.767053011 (920h51m22.119838119s) [noise=true , address=77.90.31.19:4843 , piece_id=IYRHIQELU4RNWJWIZPROXGXZG4NOLRFMSJPCEOMV7VLSDGR2BDSQ, seg_pos={0 0}, upload=810396]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: rpc: dial tcp 77.90.31.19:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:59:46.767062258 (920h51m22.119847357s) [noise=true , address=45.91.116.8:4045 , piece_id=LB7EGHVCMWTFSU2EB6MFWBTM5QOCVNIM5TVZOOZ6SJYG6RWZ4YRA, seg_pos={0 0}, upload=810396]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: rpc: dial tcp 45.91.116.8:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:59:46.767099288 (920h51m22.119884386s) [noise=true , address=77.90.31.18:4806 , piece_id=XATR6BCBWWGW7MCRTINSXLRNJN4C2HTMMEYPMCVOV5CSR6WPCDJQ, seg_pos={0 0}, upload=810396]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 5.161.89.252:29856->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:59:46.767128793 (920h51m22.119913891s) [noise=true , address=77.90.31.16:4735 , piece_id=AZSWZFTS7NAJV4BSRW6XJBIDEVXVCSUCD3G62DCHGE32EQ3T7L6A, seg_pos={0 0}, upload=810396]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: read tcp 5.161.89.252:18118->77.90.31.16:4735: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:59:46.767193314 (920h51m22.119978422s) [noise=true , address=77.90.31.13:4628 , piece_id=TOKVZ3BNEQRRJHT2CZC7QCUW6VRY4EMMYR3IR7KCHKKE64SFP3DA, seg_pos={0 0}, upload=810396]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:46942->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:59:46.767221136 (920h51m22.120006244s) [noise=true , address=45.91.116.8:4047 , piece_id=2FXFKXPPYDGGCLDPCVPKQVAFDD7ZKBJJCBBL66QBYQICKLIQV6HA, seg_pos={0 0}, upload=810396]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 5.161.89.252:15610->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:59:46.767228099 (920h51m22.120013197s) [noise=true , address=77.90.31.14:4661 , piece_id=IZNZSZLU2CEC5Z7IWZCC6C2I5OJQUTKV63C2L77ULYGQWYP7JCZQ, seg_pos={0 0}, upload=810396]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 5.161.89.252:32694->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:59:46.767266401 (920h51m22.120051509s) [seg_pos={0 0}, upload=810396]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil> Oct 6 22:59:46.780560420 (920h51m22.133345518s) [upload=810396]: Done uploading segments... Oct 6 22:59:46.780570749 (920h51m22.133355847s) [upload=810396]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9) Duration: 30.015039426s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 599.33912ms FAIL (2025-10-06 22:58:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 599.367362ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 633.811737ms FAIL (2025-10-06 22:58:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 633.830143ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 397.646542ms FAIL (2025-10-06 22:58:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 397.664767ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 971.755647ms FAIL (2025-10-06 22:57:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 971.776216ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 400.702467ms FAIL (2025-10-06 22:57:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 400.731922ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 612.355923ms FAIL (2025-10-06 22:56:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 612.372274ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 628.659917ms FAIL (2025-10-06 22:56:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 628.681658ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 450.037347ms FAIL (2025-10-06 22:55:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 450.053258ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 746.537128ms FAIL (2025-10-06 22:55:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 746.560351ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 725.658983ms FAIL (2025-10-06 22:55:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 725.67412ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 426.146775ms FAIL (2025-10-06 22:54:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 426.168536ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 643.6646ms FAIL (2025-10-06 22:54:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 643.690068ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 384.048468ms FAIL (2025-10-06 22:54:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 384.066021ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 614.959651ms FAIL (2025-10-06 22:54:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 615.024053ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 443.469832ms FAIL (2025-10-06 22:53:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 443.492834ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 25.529795439s FAIL (2025-10-06 22:53:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 25.529844701s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 462.850135ms FAIL (2025-10-06 22:53:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 462.872979ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001152217s FAIL (2025-10-06 22:52:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001167536s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 647.9003ms FAIL (2025-10-06 22:52:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 648.005357ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.028396765s FAIL (2025-10-06 22:52:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 11) ======LOGS====== Oct 6 22:52:07.085664642 (920h43m42.43844975s) [upload=810289]: Starting upload Oct 6 22:52:07.085718022 (920h43m42.43850312s) [upload=810289]: Done starting upload Oct 6 22:52:07.085785861 (920h43m42.438570959s) [upload=810289]: Uploading segments... Oct 6 22:52:07.085938557 (920h43m42.438723665s) [upload=810289]: Got next segment. Inline: false Oct 6 22:52:07.085982189 (920h43m42.438767297s) [upload=810289]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 6 22:52:07.085985796 (920h43m42.438770904s) [upload=810289]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 6 22:52:07.207985064 (920h43m42.560770162s) [seg_pos={0 0}, upload=810289]: Begin upload segment... Oct 6 22:52:07.208023997 (920h43m42.560809105s) [seg_pos={0 0}, upload=810289]: Done begin upload segment. Oct 6 22:52:07.208043784 (920h43m42.560828882s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208073319 (920h43m42.560858418s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208358405 (920h43m42.561143513s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208443224 (920h43m42.561228332s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208666633 (920h43m42.561451741s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208781950 (920h43m42.561567047s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.208954804 (920h43m42.561739912s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209120746 (920h43m42.561905844s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209327534 (920h43m42.562112642s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209469260 (920h43m42.562254368s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209608591 (920h43m42.562393699s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209789491 (920h43m42.56257459s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.209864812 (920h43m42.56264992s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210091267 (920h43m42.562876365s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210165837 (920h43m42.562950945s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.210382655 (920h43m42.563167753s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Uploading piece... Oct 6 22:52:07.288266921 (920h43m42.641052019s) [upload=810289]: Next returned nil segment Oct 6 22:52:07.288278964 (920h43m42.641064072s) [upload=810289]: Waiting for error group managing segments... Oct 6 22:52:07.294983248 (920h43m42.647768366s) [noise=true , address=145.79.227.18:4006 , piece_id=VUMZSP6KB4APZUBSHTMTH3RG5KXSTWVK67WAXJRNSNZ2IRZHTYHQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.295324959 (920h43m42.648110067s) [noise=true , address=145.79.227.6:4258 , piece_id=3LTXME4D4YCNS73OFQHWQFLITLBUZRCOM4RUTY2NTVDIHNTWIYMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296029471 (920h43m42.648814579s) [noise=true , address=145.79.227.19:4079 , piece_id=JWNLVZWHJFDG6XQLE74GEOEE2BUMCYHSIMR5J5HX6E62BWNW4Z4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296228866 (920h43m42.649013964s) [noise=true , address=145.79.227.7:4294 , piece_id=65VVK55TDWRY2O6QUTSSXVIB5Q35JZ2UTOYHO2X5TX2AVWB3EFJQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296615341 (920h43m42.649400449s) [noise=true , address=145.79.227.11:4730 , piece_id=IPKMQAN542KCDYHWBGPRN6NO4PAEMF5X2EUY6H27FQHD7ZG4VITA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296714677 (920h43m42.649499795s) [noise=true , address=145.79.227.11:4729 , piece_id=3DN27IWJRX3ICTO75MIYYXXJPOYGA6JUW3HR5JHZPG4LHR5J6GWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.296940612 (920h43m42.64972572s) [noise=true , address=145.79.227.18:4007 , piece_id=B75KDS6MJ5ZTCAXPNKG4JLFGHLJXGYDXH5OIRCIJJRP5COHYX44A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297751894 (920h43m42.650537002s) [noise=true , address=145.79.227.14:4840 , piece_id=JQXO2ZPGI2QSWIVK2F7BVC45FVQAVNJOXFJYRUDPLJJM3XYEGP4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.297901645 (920h43m42.650686763s) [noise=true , address=145.79.227.17:4970 , piece_id=DAIRTI4TR7O2SWIPXPQFRXJEWZNRTW5CPSZG7AMNIGIXIYMGM67A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.298080060 (920h43m42.650865168s) [noise=true , address=145.79.227.4:4186 , piece_id=DG4N2SAWQEWW53O6WX4MQVVIZEWLBDN6GXZB5KM4IZZDE6MNGFKA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:07.305919254 (920h43m42.658704362s) [noise=true , address=145.79.227.2:4115 , piece_id=N52JN3TOY7X7YSKAW4UUOR2JJ57J55UMGEO27Z3STINLVG6VPAMA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: <nil> Oct 6 22:52:37.074197672 (920h44m12.4269828s) [noise=true , address=45.91.116.14:4191 , piece_id=TC42MWRESI3IXIF4NEY34NMSZVFWKD63M23ZOBYOQ2LFLHUXNTWA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 5.161.89.252:8642->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074227959 (920h44m12.427013077s) [noise=true , address=77.90.31.11:4555 , piece_id=HE77RXBITG7SXX6ZK3W5AJ4SXVLCHWQFAJMTUH4J23QSSZIH4JTQ, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074298190 (920h44m12.427083319s) [noise=true , address=77.90.31.14:4663 , piece_id=35JR4SOOVOOXS3U7FMZ5MUMZRQRFMJHSNDZTTUQJAPUYTW3NUX4A, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: context deadline exceeded; context deadline exceeded Oct 6 22:52:37.074319331 (920h44m12.427104449s) [noise=true , address=45.91.116.6:4975 , piece_id=WQRMGTC44NY22AM5NTA4YOEHFTCVG2DFCCQJFFEA2AMISKZU75NA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:52:37.074456659 (920h44m12.427241787s) [noise=true , address=45.91.116.5:4298 , piece_id=NOI6WG3V7XVXDMFIDK56XVXJGNSG3FDN5PKL4ZJUGO3ZECQOH7UA, seg_pos={0 0}, upload=810289]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:18546->45.91.116.5:4298: use of closed network connection; context deadline exceeded Oct 6 22:52:37.074475955 (920h44m12.427261083s) [seg_pos={0 0}, upload=810289]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil> Oct 6 22:52:37.100535469 (920h44m12.453320597s) [upload=810289]: Done uploading segments... Oct 6 22:52:37.100551418 (920h44m12.453336547s) [upload=810289]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11) Duration: 30.028423775s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 443.771737ms FAIL (2025-10-06 22:44:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== IJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888801758 (919h55m48.241586885s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888849046 (919h55m48.241634184s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889177863 (919h55m48.241962991s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889228187 (919h55m48.242013315s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889561983 (919h55m48.242347111s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889590457 (919h55m48.242375596s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889975379 (919h55m48.242760508s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890015104 (919h55m48.242800242s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890339002 (919h55m48.243124139s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890403111 (919h55m48.24318824s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890744582 (919h55m48.243529711s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890826446 (919h55m48.243611584s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891117603 (919h55m48.243902731s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891343226 (919h55m48.244128374s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891480854 (919h55m48.244265992s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891977826 (919h55m48.244762994s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.978871730 (919h55m48.331656869s) [upload=809580]: Next returned nil segment Oct 6 22:04:12.978887169 (919h55m48.331672307s) [upload=809580]: Waiting for error group managing segments... Oct 6 22:04:12.993729077 (919h55m48.346514244s) [noise=true , address=145.79.227.30:4763 , piece_id=W7MGOUWAGBIGXISZK3F3CFAMLCGBCPIJZH7H6OIRMMBOMSSFQJXA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.001341318 (919h55m48.354126476s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.009635531 (919h55m48.362420669s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023151210 (919h55m48.375936338s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023967621 (919h55m48.376777265s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.026504631 (919h55m48.379289769s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.612028227 (919h55m48.964813325s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:07.995204035 (919h56m43.347989133s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:11.797420475 (919h56m47.150205604s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.433766825 (919h56m47.786551954s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.836500501 (919h56m48.189285599s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: read tcp 5.161.89.252:19670->77.90.31.15:4727: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836551367 (919h56m48.189336475s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 5.161.89.252:64496->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836584068 (919h56m48.189369176s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12E2nbaYSxeiBd8NdLfnpkoZ5ef7M13AfrfpKkyrRtNaE19Whso, address:77.90.31.14:4666): protocol: rpc: dial tcp 77.90.31.14:4666: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836625666 (919h56m48.189410764s) [noise=true , address=77.90.31.19:4866 , piece_id=EWVZAHYGOIJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12uCbmPHVXpukjQahs2G6oh7VY2zDMooMAbdgSyHN7Biuesmz3A, address:77.90.31.19:4866): protocol: read tcp 5.161.89.252:17420->77.90.31.19:4866: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836682613 (919h56m48.189467721s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: read tcp 5.161.89.252:19568->77.90.31.18:4816: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836772732 (919h56m48.18955784s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1RNs9MM9jDtNC2gZC63SYsePZTd5mE7dqUm9A5Z5QWdPX8PVnp, address:45.91.116.6:4985): protocol: read tcp 5.161.89.252:33492->45.91.116.6:4985: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836810703 (919h56m48.189595811s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 5.161.89.252:59880->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836817676 (919h56m48.189602774s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX, address:77.90.31.12:4619): protocol: read tcp 5.161.89.252:29032->77.90.31.12:4619: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836836541 (919h56m48.18962165s) [seg_pos={0 0}, upload=809580]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 6 22:05:12.852868321 (919h56m48.205653419s) [upload=809580]: Done uploading segments... Oct 6 22:05:12.852888118 (919h56m48.205673226s) [upload=809580]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 443.788729ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 423.554396ms FAIL (2025-10-06 22:44:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== IJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888801758 (919h55m48.241586885s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888849046 (919h55m48.241634184s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889177863 (919h55m48.241962991s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889228187 (919h55m48.242013315s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889561983 (919h55m48.242347111s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889590457 (919h55m48.242375596s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889975379 (919h55m48.242760508s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890015104 (919h55m48.242800242s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890339002 (919h55m48.243124139s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890403111 (919h55m48.24318824s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890744582 (919h55m48.243529711s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890826446 (919h55m48.243611584s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891117603 (919h55m48.243902731s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891343226 (919h55m48.244128374s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891480854 (919h55m48.244265992s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891977826 (919h55m48.244762994s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.978871730 (919h55m48.331656869s) [upload=809580]: Next returned nil segment Oct 6 22:04:12.978887169 (919h55m48.331672307s) [upload=809580]: Waiting for error group managing segments... Oct 6 22:04:12.993729077 (919h55m48.346514244s) [noise=true , address=145.79.227.30:4763 , piece_id=W7MGOUWAGBIGXISZK3F3CFAMLCGBCPIJZH7H6OIRMMBOMSSFQJXA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.001341318 (919h55m48.354126476s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.009635531 (919h55m48.362420669s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023151210 (919h55m48.375936338s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023967621 (919h55m48.376777265s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.026504631 (919h55m48.379289769s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.612028227 (919h55m48.964813325s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:07.995204035 (919h56m43.347989133s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:11.797420475 (919h56m47.150205604s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.433766825 (919h56m47.786551954s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.836500501 (919h56m48.189285599s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: read tcp 5.161.89.252:19670->77.90.31.15:4727: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836551367 (919h56m48.189336475s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 5.161.89.252:64496->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836584068 (919h56m48.189369176s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12E2nbaYSxeiBd8NdLfnpkoZ5ef7M13AfrfpKkyrRtNaE19Whso, address:77.90.31.14:4666): protocol: rpc: dial tcp 77.90.31.14:4666: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836625666 (919h56m48.189410764s) [noise=true , address=77.90.31.19:4866 , piece_id=EWVZAHYGOIJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12uCbmPHVXpukjQahs2G6oh7VY2zDMooMAbdgSyHN7Biuesmz3A, address:77.90.31.19:4866): protocol: read tcp 5.161.89.252:17420->77.90.31.19:4866: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836682613 (919h56m48.189467721s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: read tcp 5.161.89.252:19568->77.90.31.18:4816: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836772732 (919h56m48.18955784s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1RNs9MM9jDtNC2gZC63SYsePZTd5mE7dqUm9A5Z5QWdPX8PVnp, address:45.91.116.6:4985): protocol: read tcp 5.161.89.252:33492->45.91.116.6:4985: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836810703 (919h56m48.189595811s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 5.161.89.252:59880->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836817676 (919h56m48.189602774s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX, address:77.90.31.12:4619): protocol: read tcp 5.161.89.252:29032->77.90.31.12:4619: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836836541 (919h56m48.18962165s) [seg_pos={0 0}, upload=809580]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 6 22:05:12.852868321 (919h56m48.205653419s) [upload=809580]: Done uploading segments... Oct 6 22:05:12.852888118 (919h56m48.205673226s) [upload=809580]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 423.575827ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 444.59379ms FAIL (2025-10-06 22:43:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== IJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888801758 (919h55m48.241586885s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888849046 (919h55m48.241634184s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889177863 (919h55m48.241962991s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889228187 (919h55m48.242013315s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889561983 (919h55m48.242347111s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889590457 (919h55m48.242375596s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889975379 (919h55m48.242760508s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890015104 (919h55m48.242800242s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890339002 (919h55m48.243124139s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890403111 (919h55m48.24318824s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890744582 (919h55m48.243529711s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890826446 (919h55m48.243611584s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891117603 (919h55m48.243902731s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891343226 (919h55m48.244128374s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891480854 (919h55m48.244265992s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891977826 (919h55m48.244762994s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.978871730 (919h55m48.331656869s) [upload=809580]: Next returned nil segment Oct 6 22:04:12.978887169 (919h55m48.331672307s) [upload=809580]: Waiting for error group managing segments... Oct 6 22:04:12.993729077 (919h55m48.346514244s) [noise=true , address=145.79.227.30:4763 , piece_id=W7MGOUWAGBIGXISZK3F3CFAMLCGBCPIJZH7H6OIRMMBOMSSFQJXA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.001341318 (919h55m48.354126476s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.009635531 (919h55m48.362420669s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023151210 (919h55m48.375936338s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023967621 (919h55m48.376777265s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.026504631 (919h55m48.379289769s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.612028227 (919h55m48.964813325s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:07.995204035 (919h56m43.347989133s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:11.797420475 (919h56m47.150205604s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.433766825 (919h56m47.786551954s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.836500501 (919h56m48.189285599s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: read tcp 5.161.89.252:19670->77.90.31.15:4727: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836551367 (919h56m48.189336475s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 5.161.89.252:64496->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836584068 (919h56m48.189369176s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12E2nbaYSxeiBd8NdLfnpkoZ5ef7M13AfrfpKkyrRtNaE19Whso, address:77.90.31.14:4666): protocol: rpc: dial tcp 77.90.31.14:4666: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836625666 (919h56m48.189410764s) [noise=true , address=77.90.31.19:4866 , piece_id=EWVZAHYGOIJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12uCbmPHVXpukjQahs2G6oh7VY2zDMooMAbdgSyHN7Biuesmz3A, address:77.90.31.19:4866): protocol: read tcp 5.161.89.252:17420->77.90.31.19:4866: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836682613 (919h56m48.189467721s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: read tcp 5.161.89.252:19568->77.90.31.18:4816: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836772732 (919h56m48.18955784s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1RNs9MM9jDtNC2gZC63SYsePZTd5mE7dqUm9A5Z5QWdPX8PVnp, address:45.91.116.6:4985): protocol: read tcp 5.161.89.252:33492->45.91.116.6:4985: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836810703 (919h56m48.189595811s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 5.161.89.252:59880->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836817676 (919h56m48.189602774s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX, address:77.90.31.12:4619): protocol: read tcp 5.161.89.252:29032->77.90.31.12:4619: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836836541 (919h56m48.18962165s) [seg_pos={0 0}, upload=809580]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 6 22:05:12.852868321 (919h56m48.205653419s) [upload=809580]: Done uploading segments... Oct 6 22:05:12.852888118 (919h56m48.205673226s) [upload=809580]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 444.620321ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 524.415943ms FAIL (2025-10-06 22:43:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== IJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888801758 (919h55m48.241586885s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888849046 (919h55m48.241634184s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889177863 (919h55m48.241962991s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889228187 (919h55m48.242013315s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889561983 (919h55m48.242347111s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889590457 (919h55m48.242375596s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889975379 (919h55m48.242760508s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890015104 (919h55m48.242800242s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890339002 (919h55m48.243124139s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890403111 (919h55m48.24318824s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890744582 (919h55m48.243529711s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890826446 (919h55m48.243611584s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891117603 (919h55m48.243902731s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891343226 (919h55m48.244128374s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891480854 (919h55m48.244265992s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891977826 (919h55m48.244762994s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.978871730 (919h55m48.331656869s) [upload=809580]: Next returned nil segment Oct 6 22:04:12.978887169 (919h55m48.331672307s) [upload=809580]: Waiting for error group managing segments... Oct 6 22:04:12.993729077 (919h55m48.346514244s) [noise=true , address=145.79.227.30:4763 , piece_id=W7MGOUWAGBIGXISZK3F3CFAMLCGBCPIJZH7H6OIRMMBOMSSFQJXA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.001341318 (919h55m48.354126476s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.009635531 (919h55m48.362420669s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023151210 (919h55m48.375936338s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023967621 (919h55m48.376777265s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.026504631 (919h55m48.379289769s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.612028227 (919h55m48.964813325s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:07.995204035 (919h56m43.347989133s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:11.797420475 (919h56m47.150205604s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.433766825 (919h56m47.786551954s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.836500501 (919h56m48.189285599s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: read tcp 5.161.89.252:19670->77.90.31.15:4727: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836551367 (919h56m48.189336475s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 5.161.89.252:64496->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836584068 (919h56m48.189369176s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12E2nbaYSxeiBd8NdLfnpkoZ5ef7M13AfrfpKkyrRtNaE19Whso, address:77.90.31.14:4666): protocol: rpc: dial tcp 77.90.31.14:4666: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836625666 (919h56m48.189410764s) [noise=true , address=77.90.31.19:4866 , piece_id=EWVZAHYGOIJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12uCbmPHVXpukjQahs2G6oh7VY2zDMooMAbdgSyHN7Biuesmz3A, address:77.90.31.19:4866): protocol: read tcp 5.161.89.252:17420->77.90.31.19:4866: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836682613 (919h56m48.189467721s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: read tcp 5.161.89.252:19568->77.90.31.18:4816: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836772732 (919h56m48.18955784s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1RNs9MM9jDtNC2gZC63SYsePZTd5mE7dqUm9A5Z5QWdPX8PVnp, address:45.91.116.6:4985): protocol: read tcp 5.161.89.252:33492->45.91.116.6:4985: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836810703 (919h56m48.189595811s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 5.161.89.252:59880->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836817676 (919h56m48.189602774s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX, address:77.90.31.12:4619): protocol: read tcp 5.161.89.252:29032->77.90.31.12:4619: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836836541 (919h56m48.18962165s) [seg_pos={0 0}, upload=809580]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 6 22:05:12.852868321 (919h56m48.205653419s) [upload=809580]: Done uploading segments... Oct 6 22:05:12.852888118 (919h56m48.205673226s) [upload=809580]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 524.446812ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 472.068589ms FAIL (2025-10-06 22:42:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== IJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888801758 (919h55m48.241586885s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888849046 (919h55m48.241634184s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889177863 (919h55m48.241962991s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889228187 (919h55m48.242013315s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889561983 (919h55m48.242347111s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889590457 (919h55m48.242375596s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889975379 (919h55m48.242760508s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890015104 (919h55m48.242800242s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890339002 (919h55m48.243124139s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890403111 (919h55m48.24318824s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890744582 (919h55m48.243529711s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890826446 (919h55m48.243611584s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891117603 (919h55m48.243902731s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891343226 (919h55m48.244128374s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891480854 (919h55m48.244265992s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891977826 (919h55m48.244762994s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.978871730 (919h55m48.331656869s) [upload=809580]: Next returned nil segment Oct 6 22:04:12.978887169 (919h55m48.331672307s) [upload=809580]: Waiting for error group managing segments... Oct 6 22:04:12.993729077 (919h55m48.346514244s) [noise=true , address=145.79.227.30:4763 , piece_id=W7MGOUWAGBIGXISZK3F3CFAMLCGBCPIJZH7H6OIRMMBOMSSFQJXA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.001341318 (919h55m48.354126476s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.009635531 (919h55m48.362420669s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023151210 (919h55m48.375936338s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023967621 (919h55m48.376777265s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.026504631 (919h55m48.379289769s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.612028227 (919h55m48.964813325s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:07.995204035 (919h56m43.347989133s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:11.797420475 (919h56m47.150205604s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.433766825 (919h56m47.786551954s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.836500501 (919h56m48.189285599s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: read tcp 5.161.89.252:19670->77.90.31.15:4727: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836551367 (919h56m48.189336475s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 5.161.89.252:64496->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836584068 (919h56m48.189369176s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12E2nbaYSxeiBd8NdLfnpkoZ5ef7M13AfrfpKkyrRtNaE19Whso, address:77.90.31.14:4666): protocol: rpc: dial tcp 77.90.31.14:4666: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836625666 (919h56m48.189410764s) [noise=true , address=77.90.31.19:4866 , piece_id=EWVZAHYGOIJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12uCbmPHVXpukjQahs2G6oh7VY2zDMooMAbdgSyHN7Biuesmz3A, address:77.90.31.19:4866): protocol: read tcp 5.161.89.252:17420->77.90.31.19:4866: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836682613 (919h56m48.189467721s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: read tcp 5.161.89.252:19568->77.90.31.18:4816: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836772732 (919h56m48.18955784s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1RNs9MM9jDtNC2gZC63SYsePZTd5mE7dqUm9A5Z5QWdPX8PVnp, address:45.91.116.6:4985): protocol: read tcp 5.161.89.252:33492->45.91.116.6:4985: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836810703 (919h56m48.189595811s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 5.161.89.252:59880->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836817676 (919h56m48.189602774s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX, address:77.90.31.12:4619): protocol: read tcp 5.161.89.252:29032->77.90.31.12:4619: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836836541 (919h56m48.18962165s) [seg_pos={0 0}, upload=809580]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 6 22:05:12.852868321 (919h56m48.205653419s) [upload=809580]: Done uploading segments... Oct 6 22:05:12.852888118 (919h56m48.205673226s) [upload=809580]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 472.096271ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 534.367496ms FAIL (2025-10-06 22:42:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== IJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888801758 (919h55m48.241586885s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888849046 (919h55m48.241634184s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889177863 (919h55m48.241962991s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889228187 (919h55m48.242013315s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889561983 (919h55m48.242347111s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889590457 (919h55m48.242375596s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889975379 (919h55m48.242760508s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890015104 (919h55m48.242800242s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890339002 (919h55m48.243124139s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890403111 (919h55m48.24318824s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890744582 (919h55m48.243529711s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890826446 (919h55m48.243611584s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891117603 (919h55m48.243902731s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891343226 (919h55m48.244128374s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891480854 (919h55m48.244265992s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891977826 (919h55m48.244762994s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.978871730 (919h55m48.331656869s) [upload=809580]: Next returned nil segment Oct 6 22:04:12.978887169 (919h55m48.331672307s) [upload=809580]: Waiting for error group managing segments... Oct 6 22:04:12.993729077 (919h55m48.346514244s) [noise=true , address=145.79.227.30:4763 , piece_id=W7MGOUWAGBIGXISZK3F3CFAMLCGBCPIJZH7H6OIRMMBOMSSFQJXA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.001341318 (919h55m48.354126476s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.009635531 (919h55m48.362420669s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023151210 (919h55m48.375936338s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023967621 (919h55m48.376777265s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.026504631 (919h55m48.379289769s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.612028227 (919h55m48.964813325s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:07.995204035 (919h56m43.347989133s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:11.797420475 (919h56m47.150205604s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.433766825 (919h56m47.786551954s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.836500501 (919h56m48.189285599s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: read tcp 5.161.89.252:19670->77.90.31.15:4727: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836551367 (919h56m48.189336475s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 5.161.89.252:64496->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836584068 (919h56m48.189369176s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12E2nbaYSxeiBd8NdLfnpkoZ5ef7M13AfrfpKkyrRtNaE19Whso, address:77.90.31.14:4666): protocol: rpc: dial tcp 77.90.31.14:4666: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836625666 (919h56m48.189410764s) [noise=true , address=77.90.31.19:4866 , piece_id=EWVZAHYGOIJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12uCbmPHVXpukjQahs2G6oh7VY2zDMooMAbdgSyHN7Biuesmz3A, address:77.90.31.19:4866): protocol: read tcp 5.161.89.252:17420->77.90.31.19:4866: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836682613 (919h56m48.189467721s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: read tcp 5.161.89.252:19568->77.90.31.18:4816: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836772732 (919h56m48.18955784s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1RNs9MM9jDtNC2gZC63SYsePZTd5mE7dqUm9A5Z5QWdPX8PVnp, address:45.91.116.6:4985): protocol: read tcp 5.161.89.252:33492->45.91.116.6:4985: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836810703 (919h56m48.189595811s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 5.161.89.252:59880->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836817676 (919h56m48.189602774s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX, address:77.90.31.12:4619): protocol: read tcp 5.161.89.252:29032->77.90.31.12:4619: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836836541 (919h56m48.18962165s) [seg_pos={0 0}, upload=809580]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 6 22:05:12.852868321 (919h56m48.205653419s) [upload=809580]: Done uploading segments... Oct 6 22:05:12.852888118 (919h56m48.205673226s) [upload=809580]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 534.393165ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 461.630454ms FAIL (2025-10-06 22:41:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 10) ======LOGS====== IJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888801758 (919h55m48.241586885s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.888849046 (919h55m48.241634184s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889177863 (919h55m48.241962991s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889228187 (919h55m48.242013315s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889561983 (919h55m48.242347111s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889590457 (919h55m48.242375596s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.889975379 (919h55m48.242760508s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890015104 (919h55m48.242800242s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890339002 (919h55m48.243124139s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890403111 (919h55m48.24318824s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890744582 (919h55m48.243529711s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.890826446 (919h55m48.243611584s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891117603 (919h55m48.243902731s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891343226 (919h55m48.244128374s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891480854 (919h55m48.244265992s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.891977826 (919h55m48.244762994s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Uploading piece... Oct 6 22:04:12.978871730 (919h55m48.331656869s) [upload=809580]: Next returned nil segment Oct 6 22:04:12.978887169 (919h55m48.331672307s) [upload=809580]: Waiting for error group managing segments... Oct 6 22:04:12.993729077 (919h55m48.346514244s) [noise=true , address=145.79.227.30:4763 , piece_id=W7MGOUWAGBIGXISZK3F3CFAMLCGBCPIJZH7H6OIRMMBOMSSFQJXA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.001341318 (919h55m48.354126476s) [noise=true , address=145.79.227.33:4872 , piece_id=OJXNAFAIBNMBVKVUBG7SB2R4RUM27B4SNXKKPSQLKZC4LSGKUBNA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.009635531 (919h55m48.362420669s) [noise=true , address=145.79.227.49:4341 , piece_id=O4JV7I7GJUVIHYLL2BGWMMQ7DMOB5HQEVV2PV2DAXKZM7BRKMWYQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023151210 (919h55m48.375936338s) [noise=true , address=145.79.227.38:4001 , piece_id=WWPU7V3JPJOVVB5VLMYQ2BU2NKHN7NOAMWZFLRVQPVYMYWSE7BDA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.023967621 (919h55m48.376777265s) [noise=true , address=145.79.227.28:4732 , piece_id=FWVMAFNB6AYPDFLJIYFGFGIBLBKAWXRIKKH45TVOJ67L62ECML3A, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.026504631 (919h55m48.379289769s) [noise=true , address=145.79.227.27:4713 , piece_id=T3N56JQXHWNR2NNKT7FHT5QQXMPNEHXSPZDWSFI3IZW7CDLDZOUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:04:13.612028227 (919h55m48.964813325s) [noise=true , address=64.49.13.155:4923 , piece_id=MRGV4VYISKJWC3NDOOG4RY7YYL34A5YC26BDEMGLHE2Z57M7HGRQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:07.995204035 (919h56m43.347989133s) [noise=true , address=45.91.116.12:4254 , piece_id=OKK24432KOFVPWIG6PPNJQUWCTDYT3WG3CH2T3FS7QFUA5FX2UFA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:11.797420475 (919h56m47.150205604s) [noise=true , address=45.91.116.4:4943 , piece_id=APE4CTPLDDAHQA2G6KURTLBKLP55FPDGYAYIWBLKBPXG3KTT3KRA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.433766825 (919h56m47.786551954s) [noise=true , address=77.90.31.16:4742 , piece_id=6Z3TLGJZXHXH5D6AKWVBE3VNOQXISC2S2KB3GWMAYEQG3WJ56DLA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: <nil> Oct 6 22:05:12.836500501 (919h56m48.189285599s) [noise=true , address=77.90.31.15:4727 , piece_id=75EQFPGOZNDHMHZZTZDIH7XKKRQ7RYDZMPZUWR7454W7V276G2IA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: read tcp 5.161.89.252:19670->77.90.31.15:4727: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836551367 (919h56m48.189336475s) [noise=true , address=45.91.116.9:4270 , piece_id=D2C4JCT3ONVFTPRT6WUZWL2WSNRZ26JO3NCSBXD6CHQOCXNLJQWQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1Vr5WmL6Gem29LQTsCwQNFuqw6j4b1nj35AgbUWDA2Lyxf43YL, address:45.91.116.9:4270): protocol: read tcp 5.161.89.252:64496->45.91.116.9:4270: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836584068 (919h56m48.189369176s) [noise=true , address=77.90.31.14:4666 , piece_id=NMQ4ZFU5HSXLHU2YZWAIBCWQRFK65FBONSVHTEVEG5TO6DYNVYHA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12E2nbaYSxeiBd8NdLfnpkoZ5ef7M13AfrfpKkyrRtNaE19Whso, address:77.90.31.14:4666): protocol: rpc: dial tcp 77.90.31.14:4666: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836625666 (919h56m48.189410764s) [noise=true , address=77.90.31.19:4866 , piece_id=EWVZAHYGOIJI6NNVYTG6QZMJOPVGPYEZ6NZGZWVAZ63H3G43GYTA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12uCbmPHVXpukjQahs2G6oh7VY2zDMooMAbdgSyHN7Biuesmz3A, address:77.90.31.19:4866): protocol: read tcp 5.161.89.252:17420->77.90.31.19:4866: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836682613 (919h56m48.189467721s) [noise=true , address=77.90.31.18:4816 , piece_id=IQ5DUIVUWQQGT4YXOLJZVSNSLGS5TI5OVQB5LA4P5YLOWDFBM4QQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Vno3GkFXR7KdTUEAhvesqif7KBF6DZoeMTv8n9MpRbYZNktaT, address:77.90.31.18:4816): protocol: read tcp 5.161.89.252:19568->77.90.31.18:4816: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836772732 (919h56m48.18955784s) [noise=true , address=45.91.116.6:4985 , piece_id=N6O22WRK45D3DV5G4WXQQ5WXABJ5E76ZZCMHSSGV6QBYOMSJLTUQ, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:1RNs9MM9jDtNC2gZC63SYsePZTd5mE7dqUm9A5Z5QWdPX8PVnp, address:45.91.116.6:4985): protocol: read tcp 5.161.89.252:33492->45.91.116.6:4985: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836810703 (919h56m48.189595811s) [noise=true , address=77.90.31.10:4550 , piece_id=WD533H6XG4HMKYSUEEA2KZWXK4MFNBRKZ2LGMZPOISBIJWWW4IUA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12nfBW1W3RvEGzRz2bYA1hGxMfvsxVR6WNn5oPUdtJU26KMXNE7, address:77.90.31.10:4550): protocol: read tcp 5.161.89.252:59880->77.90.31.10:4550: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836817676 (919h56m48.189602774s) [noise=true , address=77.90.31.12:4619 , piece_id=P4IFXWZJFGT77P2WH67QGT4ADQUPZ7JVDJDR67YHNR3MHV5ED2TA, seg_pos={0 0}, upload=809580]: Done uploading piece. err: ecclient: upload failed (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX, address:77.90.31.12:4619): protocol: read tcp 5.161.89.252:29032->77.90.31.12:4619: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Oct 6 22:05:12.836836541 (919h56m48.18962165s) [seg_pos={0 0}, upload=809580]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil> Oct 6 22:05:12.852868321 (919h56m48.205653419s) [upload=809580]: Done uploading segments... Oct 6 22:05:12.852888118 (919h56m48.205673226s) [upload=809580]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10) Duration: 461.655521ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)