Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........X...XX.............................................] duration: 790.032517ms FAIL (2025-09-11 22:20:37 UTC) orbiter warning: context deadline exceeded Duration: 790.057925ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...XX..................................................] duration: 478.583735ms FAIL (2025-09-11 22:20:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 478.605907ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........X...XX............................................] duration: 651.094699ms FAIL (2025-09-11 22:20:12 UTC) orbiter warning: context deadline exceeded Duration: 651.111069ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.....X...XX...XXXXXXX..X....................................] duration: 664.690305ms FAIL (2025-09-11 22:19:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 664.712336ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X....X...XX.................................................] duration: 507.592656ms FAIL (2025-09-11 22:19:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 507.619326ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........X...XX...........................................] duration: 757.906015ms FAIL (2025-09-11 22:19:09 UTC) orbiter warning: context deadline exceeded Duration: 757.921533ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X....X...XX................................................] duration: 539.025879ms FAIL (2025-09-11 22:18:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 539.049673ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [......X...XX...XXXXXXX..X...................................] duration: 487.572787ms FAIL (2025-09-11 22:18:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 487.588737ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [............X...XX..........................................] duration: 745.686233ms FAIL (2025-09-11 22:18:26 UTC) orbiter warning: context deadline exceeded Duration: 745.726499ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X....X...XX...............................................] duration: 461.248344ms FAIL (2025-09-11 22:17:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 461.273189ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.......X...XX...XXXXXXX..X..................................] duration: 812.070524ms FAIL (2025-09-11 22:17:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 812.087906ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............X...XX.........................................] duration: 787.53524ms FAIL (2025-09-11 22:17:28 UTC) orbiter warning: context deadline exceeded Duration: 787.557963ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X....X...XX..............................................] duration: 455.725434ms FAIL (2025-09-11 22:17:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 455.753106ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [........X...XX...XXXXXXX..X.................................] duration: 680.771619ms FAIL (2025-09-11 22:16:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 680.795635ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............X...XX........................................] duration: 1.343238773s FAIL (2025-09-11 22:16:48 UTC) orbiter warning: context deadline exceeded Duration: 1.343265374s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X....X...XX.............................................] duration: 444.505932ms FAIL (2025-09-11 22:16:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 444.531268ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.........X...XX...XXXXXXX..X................................] duration: 580.06701ms FAIL (2025-09-11 22:16:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 580.088521ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...............X...XX.......................................] duration: 1.010497003s FAIL (2025-09-11 22:15:48 UTC) orbiter warning: context deadline exceeded Duration: 1.010517841s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X....X...XX............................................] duration: 391.394246ms FAIL (2025-09-11 22:15:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 391.421036ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [................X...XX......................................] duration: 762.843989ms FAIL (2025-09-11 22:15:17 UTC) orbiter warning: context deadline exceeded Duration: 762.864607ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.....X....X...XX...........................................] duration: 647.228031ms FAIL (2025-09-11 22:15:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 647.25992ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..........X...XX...XXXXXXX..X...............................] duration: 1.247808021s FAIL (2025-09-11 22:14:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.247831513s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.....X....X...XX..........................................] duration: 421.551212ms FAIL (2025-09-11 22:14:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 421.595465ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.................X...XX.....................................] duration: 617.280327ms FAIL (2025-09-11 22:14:19 UTC) orbiter warning: context deadline exceeded Duration: 617.297289ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...........X...XX...XXXXXXX..X..............................] duration: 601.973362ms FAIL (2025-09-11 22:14:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 601.992819ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..................X...XX....................................] duration: 696.173149ms FAIL (2025-09-11 22:14:01 UTC) orbiter warning: context deadline exceeded Duration: 696.224837ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.....X....X...XX.........................................] duration: 429.945949ms FAIL (2025-09-11 22:13:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 429.985964ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...................X...XX...................................] duration: 661.841232ms FAIL (2025-09-11 22:13:30 UTC) orbiter warning: context deadline exceeded Duration: 661.862811ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [....................X...XX..................................] duration: 711.334759ms FAIL (2025-09-11 22:13:12 UTC) orbiter warning: context deadline exceeded Duration: 711.424577ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [............X...XX...XXXXXXX..X.............................] duration: 582.01965ms FAIL (2025-09-11 22:12:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 582.060637ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.....X....X...XX........................................] duration: 623.743877ms FAIL (2025-09-11 22:12:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 623.764605ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.............X...XX...XXXXXXX..X............................] duration: 499.064564ms FAIL (2025-09-11 22:12:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 499.085964ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.....X....X...XX.......................................] duration: 563.981908ms FAIL (2025-09-11 22:12:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 564.005724ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....................X...XX.................................] duration: 1.000818702s FAIL (2025-09-11 22:12:03 UTC) orbiter warning: context deadline exceeded Duration: 1.000832638s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..............X...XX...XXXXXXX..X...........................] duration: 728.929448ms FAIL (2025-09-11 22:11:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 728.953684ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................X...XX................................] duration: 705.983107ms FAIL (2025-09-11 22:11:16 UTC) orbiter warning: context deadline exceeded Duration: 706.003947ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.....X....X...XX......................................] duration: 432.071801ms FAIL (2025-09-11 22:11:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 432.088783ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......................X...XX...............................] duration: 736.66611ms FAIL (2025-09-11 22:11:00 UTC) orbiter warning: context deadline exceeded Duration: 736.686909ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................X...XX..............................] duration: 828.346828ms FAIL (2025-09-11 22:10:26 UTC) orbiter warning: context deadline exceeded Duration: 828.365053ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.....X....X...XX.....................................] duration: 396.20197ms FAIL (2025-09-11 22:10:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 396.219833ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...............X...XX...XXXXXXX..X..........................] duration: 616.364272ms FAIL (2025-09-11 22:10:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 616.381134ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.....X....X...XX....................................] duration: 367.372977ms FAIL (2025-09-11 22:09:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 367.393296ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................X...XX.............................] duration: 897.951026ms FAIL (2025-09-11 22:09:41 UTC) orbiter warning: context deadline exceeded Duration: 897.968369ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [................X...XX...XXXXXXX..X.........................] duration: 538.596015ms FAIL (2025-09-11 22:09:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 538.70512ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........................X...XX............................] duration: 670.906154ms FAIL (2025-09-11 22:09:17 UTC) orbiter warning: context deadline exceeded Duration: 670.921093ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.................X...XX...XXXXXXX..X........................] duration: 429.00157ms FAIL (2025-09-11 22:09:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 429.081251ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X.....X....X...XX...................................] duration: 628.200836ms FAIL (2025-09-11 22:09:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 628.222767ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X.....X....X...XX..................................] duration: 530.101957ms FAIL (2025-09-11 22:08:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 530.120072ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........................X...XX...........................] duration: 769.77348ms FAIL (2025-09-11 22:08:40 UTC) orbiter warning: context deadline exceeded Duration: 769.79461ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........X.....X....X...XX.................................] duration: 553.769586ms FAIL (2025-09-11 22:08:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 553.795485ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)