Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...........X..X.XXXXXX.X..XX..X.............................] duration: 386.951878ms FAIL (2025-09-19 20:43:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 386.970484ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...........XX.XXXX.XXX..X..XX...............................] duration: 399.111427ms FAIL (2025-09-19 20:43:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 399.127646ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [............X..X.XXXXXX.X..XX..X............................] duration: 718.106325ms FAIL (2025-09-19 20:43:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 718.13085ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [............XX.XXXX.XXX..X..XX..............................] duration: 422.024195ms FAIL (2025-09-19 20:43:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 422.044442ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.............X..X.XXXXXX.X..XX..X...........................] duration: 737.915076ms FAIL (2025-09-19 20:42:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 737.948148ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.............XX.XXXX.XXX..X..XX.............................] duration: 723.710452ms FAIL (2025-09-19 20:42:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 723.727935ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..............X..X.XXXXXX.X..XX..X..........................] duration: 717.104422ms FAIL (2025-09-19 20:42:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 717.120753ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...............X..X.XXXXXX.X..XX..X.........................] duration: 475.753969ms FAIL (2025-09-19 20:41:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 475.773946ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..............XX.XXXX.XXX..X..XX............................] duration: 421.96613ms FAIL (2025-09-19 20:41:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 421.99843ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [................X..X.XXXXXX.X..XX..X........................] duration: 680.647614ms FAIL (2025-09-19 20:40:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 680.667442ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...............XX.XXXX.XXX..X..XX...........................] duration: 445.950386ms FAIL (2025-09-19 20:40:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 445.993468ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.................X..X.XXXXXX.X..XX..X.......................] duration: 685.202151ms FAIL (2025-09-19 20:39:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 685.224032ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [................XX.XXXX.XXX..X..XX..........................] duration: 674.577322ms FAIL (2025-09-19 20:39:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 674.599293ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..................X..X.XXXXXX.X..XX..X......................] duration: 479.765618ms FAIL (2025-09-19 20:39:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 479.786878ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...................X..X.XXXXXX.X..XX..X.....................] duration: 507.409518ms FAIL (2025-09-19 20:38:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 507.421511ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.................XX.XXXX.XXX..X..XX.........................] duration: 708.903916ms FAIL (2025-09-19 20:38:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 708.932811ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [....................X..X.XXXXXX.X..XX..X....................] duration: 648.270488ms FAIL (2025-09-19 20:38:33 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 648.292649ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....................X..X.XXXXXX.X..XX..X...................] duration: 527.878588ms FAIL (2025-09-19 20:38:13 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 527.902943ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..................XX.XXXX.XXX..X..XX........................] duration: 749.323413ms FAIL (2025-09-19 20:37:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 749.339695ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...................XX.XXXX.XXX..X..XX.......................] duration: 423.254042ms FAIL (2025-09-19 20:37:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 423.273207ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......................X..X.XXXXXX.X..XX..X..................] duration: 585.61603ms FAIL (2025-09-19 20:36:58 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 585.639274ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [....................XX.XXXX.XXX..X..XX......................] duration: 543.528242ms FAIL (2025-09-19 20:36:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 543.544972ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.....................XX.XXXX.XXX..X..XX.....................] duration: 461.285405ms FAIL (2025-09-19 20:36:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 461.439674ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......................X..X.XXXXXX.X..XX..X.................] duration: 599.930622ms FAIL (2025-09-19 20:35:51 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 599.949027ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [......................XX.XXXX.XXX..X..XX....................] duration: 442.341653ms FAIL (2025-09-19 20:35:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 442.359657ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [........................X..X.XXXXXX.X..XX..X................] duration: 576.930649ms FAIL (2025-09-19 20:35:03 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 576.962168ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.........................X..X.XXXXXX.X..XX..X...............] duration: 611.560951ms FAIL (2025-09-19 20:34:45 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 611.584024ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.......................XX.XXXX.XXX..X..XX...................] duration: 648.657262ms FAIL (2025-09-19 20:34:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 648.677871ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [........................XX.XXXX.XXX..X..XX..................] duration: 721.68799ms FAIL (2025-09-19 20:33:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 721.707447ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..........................X..X.XXXXXX.X..XX..X..............] duration: 609.826127ms FAIL (2025-09-19 20:33:52 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 609.85487ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.........................XX.XXXX.XXX..X..XX.................] duration: 419.025286ms FAIL (2025-09-19 20:33:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 419.067094ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...........................X..X.XXXXXX.X..XX..X.............] duration: 568.536435ms FAIL (2025-09-19 20:32:56 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 568.562064ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..........................XX.XXXX.XXX..X..XX................] duration: 462.338103ms FAIL (2025-09-19 20:32:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 462.355125ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [............................X..X.XXXXXX.X..XX..X............] duration: 409.528031ms FAIL (2025-09-19 20:32:30 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 409.549691ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...........................XX.XXXX.XXX..X..XX...............] duration: 428.272029ms FAIL (2025-09-19 20:31:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 428.291725ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.............................X..X.XXXXXX.X..XX..X...........] duration: 521.551636ms FAIL (2025-09-19 20:31:46 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 521.575311ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [............................XX.XXXX.XXX..X..XX..............] duration: 456.854388ms FAIL (2025-09-19 20:31:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 456.880136ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..............................X..X.XXXXXX.X..XX..X..........] duration: 738.018588ms FAIL (2025-09-19 20:31:04 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 738.042993ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.............................XX.XXXX.XXX..X..XX.............] duration: 426.811416ms FAIL (2025-09-19 20:31:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 426.836704ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...............................X..X.XXXXXX.X..XX..X.........] duration: 553.144199ms FAIL (2025-09-19 20:30:46 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 553.168454ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [................................X..X.XXXXXX.X..XX..X........] duration: 630.107286ms FAIL (2025-09-19 20:30:14 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 630.128236ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..............................XX.XXXX.XXX..X..XX............] duration: 424.790255ms FAIL (2025-09-19 20:29:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 424.840891ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.................................X..X.XXXXXX.X..XX..X.......] duration: 449.974729ms FAIL (2025-09-19 20:29:41 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 450.00196ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...............................XX.XXXX.XXX..X..XX...........] duration: 394.08519ms FAIL (2025-09-19 20:28:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 394.103304ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..................................X..X.XXXXXX.X..XX..X......] duration: 484.454768ms FAIL (2025-09-19 20:28:35 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 484.479895ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [................................XX.XXXX.XXX..X..XX..........] duration: 491.940026ms FAIL (2025-09-19 20:28:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 491.957339ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [.................................XX.XXXX.XXX..X..XX.........] duration: 677.79837ms FAIL (2025-09-19 20:27:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 677.814769ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...................................X..X.XXXXXX.X..XX..X.....] duration: 512.483258ms FAIL (2025-09-19 20:27:41 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== .227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.845531674 (510h14m34.198316802s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846032524 (510h14m34.198817663s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846043646 (510h14m34.198828773s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846429770 (510h14m34.199214897s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846507636 (510h14m34.199292763s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846821395 (510h14m34.199606533s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.846942151 (510h14m34.19972729s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847326151 (510h14m34.20011128s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.847771057 (510h14m34.200556185s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.848334084 (510h14m34.201119212s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849219025 (510h14m34.202004153s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.849977238 (510h14m34.202762366s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851690302 (510h14m34.204475441s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.851789309 (510h14m34.204574446s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.852388703 (510h14m34.205173841s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Uploading piece... Sep 19 20:22:58.945885961 (510h14m34.29867109s) [upload=449152]: Next returned nil segment Sep 19 20:22:58.945901340 (510h14m34.298686468s) [upload=449152]: Waiting for error group managing segments... Sep 19 20:22:58.961933689 (510h14m34.314718827s) [noise=true , address=145.79.227.3:4151 , piece_id=AKKMKNHU5ODNNESGJOVGCD4JKVYIOW2ROTFCG2AZ3S4JWDXVYOAA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.977887148 (510h14m34.330672277s) [noise=true , address=145.79.227.13:4804 , piece_id=PWOMBVAGSNTH6CYJAXFQIX3YIQTLIYTAV6FRB3IF3ZW2HUKB4D6A, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.978498557 (510h14m34.331283684s) [noise=true , address=145.79.227.7:4295 , piece_id=E2S3QUZJAHYIWX2A4SJWKBBAQCLT32Q2OGQH23E5FGPKKZINP2TA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:58.979160138 (510h14m34.331945266s) [noise=true , address=145.79.227.16:4911 , piece_id=TXDTUB2CGSAVRV3ZXTKJDKA2PSB3OE72HHKMYBKQ3DCWHZXPFEFA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:22:59.206612232 (510h14m34.559397361s) [noise=true , address=145.79.227.11:4732 , piece_id=SBFP3NXNERYUD3QUSOIBVFTCNWX7O3DNBW7CFDDGMAGPQB3IT4ZA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: <nil> Sep 19 20:23:28.729557262 (510h15m4.08234236s) [noise=true , address=45.91.116.12:4225 , piece_id=WZYJUA4QTIZL54ELEAX3QRDBSXJNYYAK6OXFLY6KZSRLUUPG3NAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729641309 (510h15m4.082426417s) [noise=true , address=45.91.116.4:4938 , piece_id=FNZZM4NUB2P2VXH7U7EIY25742SQJZKENW6PNN6JL65TYQI566IQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729738503 (510h15m4.082523611s) [noise=true , address=45.91.116.8:4048 , piece_id=GK3IVYIYDZ7CUEBOVTIWRY7USYNQT33CVVTKGIIZD4PMC452UOMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: read tcp 5.161.89.252:20230->45.91.116.8:4048: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729753361 (510h15m4.082538459s) [noise=true , address=77.90.31.16:4734 , piece_id=RQA6CLX2HNCSHM5J7MOFAOGKUHZDMINODHULHGV6RR4MEU5KFBMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: rpc: dial tcp 77.90.31.16:4734: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729769100 (510h15m4.082554199s) [noise=true , address=77.90.31.14:4663 , piece_id=WIUFXMNP7CUQJXDSVY5GZ65DJV22QJZ3TDECU73PG3YHWTIPWSMA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 5.161.89.252:30010->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729804527 (510h15m4.082589625s) [noise=true , address=77.90.31.11:4555 , piece_id=A2OUQISOOJQLFJBFX4HNTKALW5JYKXGKSKRP2XL3Y3T7NPO2K6RQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729845785 (510h15m4.082630882s) [noise=true , address=45.91.116.9:4262 , piece_id=QSPIL7E4LILHAW2VPVATPPGWD577ZDLCY334DQCVOMR5YQJZXFGA, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: rpc: dial tcp 45.91.116.9:4262: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729885860 (510h15m4.082670957s) [noise=true , address=45.91.116.14:4190 , piece_id=GWES6XL46PPSZYB7AUAFLMYGIYXPNEWRAZAJKIGV6BGIXTRI4VEQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:29536->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729894906 (510h15m4.082680014s) [noise=true , address=45.91.116.5:4298 , piece_id=KEQ6RCQBQVDNQ63GUULW3GRT7FKXW52NWJLFA3AB2SDQU4HZYCXQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: read tcp 5.161.89.252:25794->45.91.116.5:4298: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729918451 (510h15m4.082703549s) [noise=true , address=77.90.31.15:4697 , piece_id=N5DR2AUKQ7AXTGIHD5KOBRMLF3AZBU4N2GUDOJTTESTA5OVFFNAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 5.161.89.252:54484->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729924962 (510h15m4.08271007s) [noise=true , address=77.90.31.10:4518 , piece_id=PBRMRQUEUAAMHMY6NBAIY7UV6UUZQ5XKDMKT2T6B4JZXRKUQFKAQ, seg_pos={0 0}, upload=449152]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 5.161.89.252:15830->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:23:28.729958696 (510h15m4.082743804s) [seg_pos={0 0}, upload=449152]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Sep 19 20:23:28.746501923 (510h15m4.099287021s) [upload=449152]: Done uploading segments... Sep 19 20:23:28.746512543 (510h15m4.099297641s) [upload=449152]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 512.53781ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [..................................XX.XXXX.XXX..X..XX........] duration: 449.113021ms FAIL (2025-09-19 20:27:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 449.150942ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 12 out of 60 is failed (threshold=3) [...................................XX.XXXX.XXX..X..XX.......] duration: 500.18002ms FAIL (2025-09-19 20:26:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 500.201179ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)