Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..................X...XX...XXXXXXX..X.......................] duration: 566.524598ms FAIL (2025-09-11 22:08:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 566.544094ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........X.....X....X...XX................................] duration: 756.286906ms FAIL (2025-09-11 22:07:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 756.33736ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [............................X...XX..........................] duration: 602.592863ms FAIL (2025-09-11 22:07:27 UTC) orbiter warning: context deadline exceeded Duration: 602.611609ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [............X.....X....X...XX...............................] duration: 436.276319ms FAIL (2025-09-11 22:07:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 436.296025ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...................X...XX...XXXXXXX..X......................] duration: 454.06741ms FAIL (2025-09-11 22:07:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 454.09374ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............................X...XX.........................] duration: 700.278715ms FAIL (2025-09-11 22:06:50 UTC) orbiter warning: context deadline exceeded Duration: 700.295607ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [....................X...XX...XXXXXXX..X.....................] duration: 830.183533ms FAIL (2025-09-11 22:06:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 830.232033ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.............X.....X....X...XX..............................] duration: 423.861725ms FAIL (2025-09-11 22:06:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 423.885781ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.....................X...XX...XXXXXXX..X....................] duration: 812.843585ms FAIL (2025-09-11 22:06:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 812.862098ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............................X...XX........................] duration: 605.478591ms FAIL (2025-09-11 22:05:53 UTC) orbiter warning: context deadline exceeded Duration: 605.530638ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..............X.....X....X...XX.............................] duration: 584.043439ms FAIL (2025-09-11 22:05:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 584.066032ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [......................X...XX...XXXXXXX..X...................] duration: 508.24172ms FAIL (2025-09-11 22:05:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 508.265544ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...............X.....X....X...XX............................] duration: 467.488455ms FAIL (2025-09-11 22:05:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 467.514996ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...............................X...XX.......................] duration: 1.058810149s FAIL (2025-09-11 22:05:14 UTC) orbiter warning: context deadline exceeded Duration: 1.058829616s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [................X.....X....X...XX...........................] duration: 666.52397ms FAIL (2025-09-11 22:04:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 666.552985ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [................................X...XX......................] duration: 783.268379ms FAIL (2025-09-11 22:04:53 UTC) orbiter warning: context deadline exceeded Duration: 783.307101ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.......................X...XX...XXXXXXX..X..................] duration: 1.364235171s FAIL (2025-09-11 22:04:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.36425629s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.................X.....X....X...XX..........................] duration: 477.808442ms FAIL (2025-09-11 22:04:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 477.832206ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.................................X...XX.....................] duration: 2.631457654s FAIL (2025-09-11 22:03:58 UTC) orbiter warning: context deadline exceeded Duration: 2.631520481s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [........................X...XX...XXXXXXX..X.................] duration: 445.108117ms FAIL (2025-09-11 22:03:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 445.1254ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..................X.....X....X...XX.........................] duration: 457.833847ms FAIL (2025-09-11 22:03:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 457.856008ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..................................X...XX....................] duration: 814.586616ms FAIL (2025-09-11 22:03:17 UTC) orbiter warning: context deadline exceeded Duration: 814.70587ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.........................X...XX...XXXXXXX..X................] duration: 567.002562ms FAIL (2025-09-11 22:02:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 567.030372ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...................................X...XX...................] duration: 737.210266ms FAIL (2025-09-11 22:02:55 UTC) orbiter warning: context deadline exceeded Duration: 737.268906ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...................X.....X....X...XX........................] duration: 501.47259ms FAIL (2025-09-11 22:02:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 501.500122ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..........................X...XX...XXXXXXX..X...............] duration: 451.923315ms FAIL (2025-09-11 22:02:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 451.935899ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [....................X.....X....X...XX.......................] duration: 503.233655ms FAIL (2025-09-11 22:01:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 503.259623ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [....................................X...XX..................] duration: 903.866706ms FAIL (2025-09-11 22:01:41 UTC) orbiter warning: context deadline exceeded Duration: 903.87918ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...........................X...XX...XXXXXXX..X..............] duration: 703.917632ms FAIL (2025-09-11 22:01:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 703.935145ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [............................X...XX...XXXXXXX..X.............] duration: 823.061786ms FAIL (2025-09-11 22:00:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 823.079851ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X...XX.................] duration: 742.703004ms FAIL (2025-09-11 22:00:30 UTC) orbiter warning: context deadline exceeded Duration: 742.885086ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....................X.....X....X...XX......................] duration: 858.751697ms FAIL (2025-09-11 22:00:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 858.777256ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.............................X...XX...XXXXXXX..X............] duration: 524.752765ms FAIL (2025-09-11 22:00:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 524.79261ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [......................X.....X....X...XX.....................] duration: 706.444614ms FAIL (2025-09-11 22:00:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 706.470813ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................................X...XX................] duration: 661.310795ms FAIL (2025-09-11 22:00:00 UTC) orbiter warning: context deadline exceeded Duration: 661.337786ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................X.....X....X...XX....................] duration: 434.089507ms FAIL (2025-09-11 21:59:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 434.134492ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..............................X...XX...XXXXXXX..X...........] duration: 634.211316ms FAIL (2025-09-11 21:59:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 634.273163ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X...XX...............] duration: 647.277524ms FAIL (2025-09-11 21:58:50 UTC) orbiter warning: context deadline exceeded Duration: 647.299274ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [........................X.....X....X...XX...................] duration: 465.051477ms FAIL (2025-09-11 21:58:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 465.079621ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [...............................X...XX...XXXXXXX..X..........] duration: 470.458879ms FAIL (2025-09-11 21:58:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 470.479708ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........................X.....X....X...XX..................] duration: 409.289149ms FAIL (2025-09-11 21:58:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 409.314917ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................................X...XX..............] duration: 1.037399522s FAIL (2025-09-11 21:57:58 UTC) orbiter warning: context deadline exceeded Duration: 1.037424138s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [................................X...XX...XXXXXXX..X.........] duration: 435.977666ms FAIL (2025-09-11 21:57:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 435.994979ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........................X.....X....X...XX.................] duration: 578.534127ms FAIL (2025-09-11 21:57:20 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 578.556449ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................................X...XX.............] duration: 665.587546ms FAIL (2025-09-11 21:57:20 UTC) orbiter warning: context deadline exceeded Duration: 665.599649ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.................................X...XX...XXXXXXX..X........] duration: 746.912451ms FAIL (2025-09-11 21:57:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 746.933351ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X...XX............] duration: 1.056837271s FAIL (2025-09-11 21:56:23 UTC) orbiter warning: context deadline exceeded Duration: 1.056868949s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [..................................X...XX...XXXXXXX..X.......] duration: 658.260383ms FAIL (2025-09-11 21:56:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 658.281392ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........................X.....X....X...XX................] duration: 373.053083ms FAIL (2025-09-11 21:56:12 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 3) ======LOGS====== Sep 11 21:45:40.463003522 (319h37m15.81578865s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463551491 (319h37m15.816336618s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.463970126 (319h37m15.816755264s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464402466 (319h37m15.817187605s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.464802326 (319h37m15.817587465s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Uploading piece... Sep 11 21:45:40.892558581 (319h37m16.24534372s) [upload=281456]: Next returned nil segment Sep 11 21:45:40.892580002 (319h37m16.245365129s) [upload=281456]: Waiting for error group managing segments... Sep 11 21:45:41.035387083 (319h37m16.388172221s) [noise=true , address=145.79.227.14:4839 , piece_id=QEMMRRLOF2TKXY7PJFSLLPGD2VWQ4POZGFOTBZAFLWP4GRWHB7MA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.036541769 (319h37m16.389326896s) [noise=true , address=145.79.227.17:4969 , piece_id=S7JY5DVXUSQBTVHVR44O4AOCKIEFXCAINAJX3XG4NC5RROKIUITQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:45:41.196799468 (319h37m16.549584597s) [noise=true , address=145.79.227.13:4803 , piece_id=VPZ3FZ6OFMHC2X4HK5LBHNMVU2AAMFW6U7EY2ZND43ULWOFTGEDQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: <nil> Sep 11 21:46:10.424396656 (319h37m45.777181764s) [noise=true , address=45.91.116.13:4155 , piece_id=7NVZE5YHVQUST2NVF5SZEF6EJPWAFLJGXMQNOSJJUXSFVR5WQ5TA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:8408->45.91.116.13:4155: use of closed network connection Sep 11 21:46:10.424472478 (319h37m45.777257576s) [noise=true , address=45.91.116.14:4190 , piece_id=SMJHAECOFSEHXHYMQKY7JLZVYNKT6CXWVHXAXRVVLMD27QBNOQBA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:59922->45.91.116.14:4190: use of closed network connection Sep 11 21:46:10.424489680 (319h37m45.777274788s) [noise=true , address=45.91.116.11:4119 , piece_id=MAC3C2IVL5JZ2A7NREPRNQ4LIHGXPEPKSKGFHMPXKKB25WO5YOOA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:42198->45.91.116.11:4119: use of closed network connection Sep 11 21:46:10.424563619 (319h37m45.777348727s) [noise=true , address=77.90.31.15:4697 , piece_id=DV7DTDIM2B7B2DTYD4Y55OTODEJDEL5ZKGEJ452MIGPFEWCMZF7Q, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27900->77.90.31.15:4697: use of closed network connection Sep 11 21:46:10.424594106 (319h37m45.777379214s) [noise=true , address=77.90.31.13:4628 , piece_id=FCGS5G5PJIW5MOYWA52AMHBAV2B34RRTPE3X2BSKFQ5IRTREP4ZA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18068->77.90.31.13:4628: use of closed network connection Sep 11 21:46:10.424617690 (319h37m45.777402788s) [noise=true , address=45.91.116.9:4261 , piece_id=DVT7RNVBMGVG7ZY3FS3IU3VQZGIKMIY2EUF576JNTP3YZBENLRKQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54690->45.91.116.9:4261: use of closed network connection Sep 11 21:46:10.424639601 (319h37m45.777424709s) [noise=true , address=45.91.116.5:4298 , piece_id=HZ5CIWWJUEVARBNP47JPB7XFKUQV25PECBIP7VBKGBKOX3PF2LRQ, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:56210->45.91.116.5:4298: use of closed network connection Sep 11 21:46:10.424658607 (319h37m45.777443715s) [noise=true , address=45.91.116.7:4009 , piece_id=6ROEZYTFXYP3MHGFWVTN23CW3HBDD6MCLGRGWMZVCRCVSNEWAYUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:19310->45.91.116.7:4009: use of closed network connection Sep 11 21:46:10.424679837 (319h37m45.777464945s) [noise=true , address=77.90.31.17:4770 , piece_id=QEEK4JZO66OYDRXM54FNHV7JEMLLLQ55ZBKPTXJEIWWQJWJGDO5A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54410->77.90.31.17:4770: use of closed network connection Sep 11 21:46:10.424719922 (319h37m45.77750503s) [noise=true , address=45.91.116.12:4226 , piece_id=MYIAGHV7UCQK7QJVPWDTK4AIVDCJ4Z2LETUHNDRPV6U5SXT6BJRA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:44568->45.91.116.12:4226: use of closed network connection Sep 11 21:46:10.424736864 (319h37m45.777521972s) [noise=true , address=77.90.31.13:4627 , piece_id=UB7DQL5YGYTJIBOO7WGBOW2RI5AEYZRJ475SMGTJSNVHK7HGTUUA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:63384->77.90.31.13:4627: use of closed network connection Sep 11 21:46:10.424749978 (319h37m45.777535086s) [noise=true , address=77.90.31.19:4841 , piece_id=RUGEOBC7PNZO2HBP2ZBOIXIPZE6FOEME7NQOL72C4DPU7FCOSVMA, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:27830->77.90.31.19:4841: use of closed network connection Sep 11 21:46:10.424807897 (319h37m45.777593005s) [noise=true , address=45.91.116.14:4189 , piece_id=TZPP5WXGVSDMPEELWZ7ZYXNE2WV6PGSC6NCRONPCRFMDIBJLF56A, seg_pos={0 0}, upload=281456]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: context deadline exceeded; context deadline exceeded Sep 11 21:46:10.424822825 (319h37m45.777607933s) [seg_pos={0 0}, upload=281456]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil> Sep 11 21:46:10.440712797 (319h37m45.793497905s) [upload=281456]: Done uploading segments... Sep 11 21:46:10.440723677 (319h37m45.793508775s) [upload=281456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3) Duration: 373.083952ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X...XX...........] duration: 729.712694ms FAIL (2025-09-11 21:55:49 UTC) orbiter warning: context deadline exceeded Duration: 729.759502ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)