Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.XX..X......................................................] duration: 615.804457ms FAIL (2025-09-19 21:03:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 615.835806ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 570.045485ms FAIL (2025-09-19 21:02:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 570.062387ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..XX..X.....................................................] duration: 723.006579ms FAIL (2025-09-19 21:02:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 723.041976ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X..XX.......................................................] duration: 744.377825ms FAIL (2025-09-19 21:02:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 744.401861ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X..XX..X....................................................] duration: 437.42371ms FAIL (2025-09-19 21:01:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 437.45ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X..XX......................................................] duration: 510.487993ms FAIL (2025-09-19 21:01:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 510.514593ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X..XX..X...................................................] duration: 912.956376ms FAIL (2025-09-19 21:01:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 912.981754ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X..XX.....................................................] duration: 432.625206ms FAIL (2025-09-19 21:00:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 432.638411ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X..X..XX....................................................] duration: 754.830454ms FAIL (2025-09-19 21:00:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 755.007866ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.X..XX..X..................................................] duration: 496.475768ms FAIL (2025-09-19 21:00:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 496.502999ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [XX..X..XX...................................................] duration: 399.859859ms FAIL (2025-09-19 20:59:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 399.876691ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [XX.X..XX..X.................................................] duration: 473.380326ms FAIL (2025-09-19 20:59:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 473.403189ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [XXX.X..XX..X................................................] duration: 563.169301ms FAIL (2025-09-19 20:59:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 563.193837ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [XXX..X..XX..................................................] duration: 456.325541ms FAIL (2025-09-19 20:58:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 456.350417ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [XXXX.X..XX..X...............................................] duration: 865.314311ms FAIL (2025-09-19 20:58:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 865.338456ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [.XXX..X..XX.................................................] duration: 506.193734ms FAIL (2025-09-19 20:57:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 506.210886ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [XXXXX.X..XX..X..............................................] duration: 695.779927ms FAIL (2025-09-19 20:57:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 695.804092ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [X.XXX..X..XX................................................] duration: 803.185573ms FAIL (2025-09-19 20:56:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 803.209908ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [XXXXXX.X..XX..X.............................................] duration: 569.425257ms FAIL (2025-09-19 20:56:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 569.445525ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [XX.XXX..X..XX...............................................] duration: 603.3647ms FAIL (2025-09-19 20:55:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 603.388325ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [.XXXXXX.X..XX..X............................................] duration: 476.470724ms FAIL (2025-09-19 20:55:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 476.588025ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [XXX.XXX..X..XX..............................................] duration: 742.489164ms FAIL (2025-09-19 20:54:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 742.505754ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [X.XXXXXX.X..XX..X...........................................] duration: 579.532675ms FAIL (2025-09-19 20:54:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 579.554457ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.X.XXXXXX.X..XX..X..........................................] duration: 571.289826ms FAIL (2025-09-19 20:54:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 571.32342ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [XXXX.XXX..X..XX.............................................] duration: 772.062068ms FAIL (2025-09-19 20:53:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 772.097805ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..X.XXXXXX.X..XX..X.........................................] duration: 478.238541ms FAIL (2025-09-19 20:53:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 478.261384ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [.XXXX.XXX..X..XX............................................] duration: 447.685123ms FAIL (2025-09-19 20:53:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 447.702565ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [X.XXXX.XXX..X..XX...........................................] duration: 453.933287ms FAIL (2025-09-19 20:52:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 453.954557ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [X..X.XXXXXX.X..XX..X........................................] duration: 422.981174ms FAIL (2025-09-19 20:52:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 423.002724ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.X..X.XXXXXX.X..XX..X.......................................] duration: 720.606706ms FAIL (2025-09-19 20:51:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 720.626552ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [XX.XXXX.XXX..X..XX..........................................] duration: 604.612884ms FAIL (2025-09-19 20:51:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 604.635446ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..X..X.XXXXXX.X..XX..X......................................] duration: 473.449163ms FAIL (2025-09-19 20:50:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 473.473709ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.XX.XXXX.XXX..X..XX.........................................] duration: 821.903805ms FAIL (2025-09-19 20:50:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 821.926899ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..XX.XXXX.XXX..X..XX........................................] duration: 486.398727ms FAIL (2025-09-19 20:50:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 486.422541ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...X..X.XXXXXX.X..XX..X.....................................] duration: 595.842034ms FAIL (2025-09-19 20:50:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 595.865218ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [....X..X.XXXXXX.X..XX..X....................................] duration: 897.093112ms FAIL (2025-09-19 20:49:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 897.112689ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...XX.XXXX.XXX..X..XX.......................................] duration: 478.133746ms FAIL (2025-09-19 20:49:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 478.158933ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [....XX.XXXX.XXX..X..XX......................................] duration: 480.735567ms FAIL (2025-09-19 20:48:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 480.773679ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....X..X.XXXXXX.X..XX..X...................................] duration: 419.498497ms FAIL (2025-09-19 20:48:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 419.514246ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......X..X.XXXXXX.X..XX..X..................................] duration: 600.712344ms FAIL (2025-09-19 20:47:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 600.7313ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....XX.XXXX.XXX..X..XX.....................................] duration: 739.038495ms FAIL (2025-09-19 20:47:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 739.058924ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......XX.XXXX.XXX..X..XX....................................] duration: 513.031856ms FAIL (2025-09-19 20:47:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 513.09233ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......X..X.XXXXXX.X..XX..X.................................] duration: 434.667854ms FAIL (2025-09-19 20:46:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 434.684615ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [........X..X.XXXXXX.X..XX..X................................] duration: 800.919734ms FAIL (2025-09-19 20:45:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 800.945251ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......XX.XXXX.XXX..X..XX...................................] duration: 433.886128ms FAIL (2025-09-19 20:45:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 433.900954ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [........XX.XXXX.XXX..X..XX..................................] duration: 440.247435ms FAIL (2025-09-19 20:45:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 440.264667ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.........X..X.XXXXXX.X..XX..X...............................] duration: 439.268048ms FAIL (2025-09-19 20:44:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 439.301451ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.........XX.XXXX.XXX..X..XX.................................] duration: 477.457368ms FAIL (2025-09-19 20:44:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 477.47469ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..........X..X.XXXXXX.X..XX..X..............................] duration: 572.702248ms FAIL (2025-09-19 20:44:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 572.722967ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..........XX.XXXX.XXX..X..XX................................] duration: 757.377098ms FAIL (2025-09-19 20:43:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 757.397296ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)