Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.398939988s FAIL (2025-08-19 17:58:22 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 1.398955749s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X...X........................................] duration: 392.657621ms FAIL (2025-08-19 17:58:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 392.679572ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 415.584998ms FAIL (2025-08-19 17:58:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== ]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:20:30.724709450 (263h54m11.4559771s) [seg_pos={0 0}, upload=274457]: Begin upload segment... Aug 19 17:20:30.724753462 (263h54m11.456021113s) [seg_pos={0 0}, upload=274457]: Done begin upload segment. Aug 19 17:20:30.724781936 (263h54m11.456049586s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.724797054 (263h54m11.456064674s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725166569 (263h54m11.456434189s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725324816 (263h54m11.456592476s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725415496 (263h54m11.456683126s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725643935 (263h54m11.456911565s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725817342 (263h54m11.457084992s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725853730 (263h54m11.45712136s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725891440 (263h54m11.457159071s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726110873 (263h54m11.457378504s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726322932 (263h54m11.457590582s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726338811 (263h54m11.457606432s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726711522 (263h54m11.457979172s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727114529 (263h54m11.458382178s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727561679 (263h54m11.458829329s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728022655 (263h54m11.459290316s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728544566 (263h54m11.459812225s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728932415 (263h54m11.460200435s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.813701018 (263h54m11.544968628s) [upload=274457]: Next returned nil segment Aug 19 17:20:30.813711287 (263h54m11.544978897s) [upload=274457]: Waiting for error group managing segments... Aug 19 17:20:30.826872026 (263h54m11.558139646s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.832633702 (263h54m11.563901332s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.834038051 (263h54m11.565305681s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.844605367 (263h54m11.575872987s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.864222729 (263h54m11.59549035s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.866711214 (263h54m11.597978835s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.882824352 (263h54m11.614091972s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:31.250301081 (263h54m11.981568741s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:11.439696042 (263h54m52.170963692s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:13.585367789 (263h54m54.316635419s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:16.506635739 (263h54m57.237903369s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:22.880177884 (263h55m3.611445533s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:30.678773057 (263h55m11.410040716s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:14fc8QANkMVxxrHcXTWi1yyDhE2gz8BJNwRuvJNfX56TyQCWYZ, address:45.91.116.7:4032): protocol: rpc: dial tcp 45.91.116.7:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678847767 (263h55m11.410115416s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1yd47We7k2qgmcAVz5DhwZQMfnX71BrmLmtBoYyLn7D8t1psh2, address:45.91.116.12:4238): protocol: read tcp 5.161.89.252:32834->45.91.116.12:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678926845 (263h55m11.410194495s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd, address:77.90.31.21:4890): protocol: rpc: dial tcp 77.90.31.21:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678951581 (263h55m11.410219241s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo, address:77.90.31.18:4829): protocol: rpc: dial tcp 77.90.31.18:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678966439 (263h55m11.410234099s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: write tcp 5.161.89.252:42466->77.90.31.14:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679024038 (263h55m11.410291688s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7, address:45.91.116.10:4107): protocol: read tcp 5.161.89.252:39718->45.91.116.10:4107: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679071326 (263h55m11.410338977s) [seg_pos={0 0}, upload=274457]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 19 17:21:30.694027780 (263h55m11.425295431s) [upload=274457]: Done uploading segments... Aug 19 17:21:30.694046335 (263h55m11.425313986s) [upload=274457]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration:* 415.608434ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..............X.X.X.............XX..........................] duration: 723.288505ms FAIL (2025-08-19 17:57:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:35:24.598550906 (264h9m5.329818526s) [upload=274709]: Starting upload Aug 19 17:35:24.598598336 (264h9m5.329865966s) [upload=274709]: Done starting upload Aug 19 17:35:24.598705527 (264h9m5.329973177s) [upload=274709]: Uploading segments... Aug 19 17:35:24.598834049 (264h9m5.330101679s) [upload=274709]: Got next segment. Inline: false Aug 19 17:35:24.598891597 (264h9m5.330159247s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:35:24.598922305 (264h9m5.330189965s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:35:24.622781310 (264h9m5.354048961s) [seg_pos={0 0}, upload=274709]: Begin upload segment... Aug 19 17:35:24.622850871 (264h9m5.35411852s) [seg_pos={0 0}, upload=274709]: Done begin upload segment. Aug 19 17:35:24.622881097 (264h9m5.354148758s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.622915473 (264h9m5.354183093s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623242778 (264h9m5.354510398s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623434598 (264h9m5.354702257s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623465406 (264h9m5.354733026s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623704975 (264h9m5.354972595s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623972749 (264h9m5.355240369s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624046368 (264h9m5.355314018s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624428025 (264h9m5.355695684s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624838907 (264h9m5.356106557s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625410892 (264h9m5.356678542s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625821152 (264h9m5.357088803s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626247935 (264h9m5.357515585s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626718509 (264h9m5.35798616s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627108321 (264h9m5.358375972s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627468548 (264h9m5.358736198s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627964190 (264h9m5.35923184s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.628364072 (264h9m5.359631721s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.722088727 (264h9m5.453356348s) [upload=274709]: Next returned nil segment Aug 19 17:35:24.722132710 (264h9m5.45340033s) [upload=274709]: Waiting for error group managing segments... Aug 19 17:35:24.742673821 (264h9m5.473941441s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.743213144 (264h9m5.474480765s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.744830845 (264h9m5.476098485s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.747023905 (264h9m5.478291526s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.753657211 (264h9m5.484924862s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.754442816 (264h9m5.485710437s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.756549285 (264h9m5.487816925s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.757132692 (264h9m5.488400312s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.758813881 (264h9m5.490081521s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.760553070 (264h9m5.491820689s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.761195576 (264h9m5.492463197s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.762297076 (264h9m5.493564726s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.778979887 (264h9m5.510247517s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785621458 (264h9m5.516889107s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785659460 (264h9m5.5169271s) [seg_pos={0 0}, upload=274709]: Segment reached optimal threshold of 14 pieces. Aug 19 17:35:24.785819780 (264h9m5.51708741s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.785925820 (264h9m5.51719347s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5pHzd3BFgkMPrMhSwTQBSxbSp7khERtcaCbZn1crJobN5zWn): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786017702 (264h9m5.517285332s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786091801 (264h9m5.517359452s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: read tcp 5.161.89.252:57194->66.23.193.175:4559: use of closed network connection; context canceled Aug 19 17:35:24.786125735 (264h9m5.517393385s) [seg_pos={0 0}, upload=274709]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 17:35:24.786208471 (264h9m5.517476122s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 17:35:24.786213561 (264h9m5.517481211s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:35:24.829790861 (264h9m5.56105848s) [upload=274709]: Done uploading segments... Aug 19 17:35:24.829804556 (264h9m5.561072186s) [upload=274709]: Upload finished. err: <nil> Duration: 723.313702ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X.....................X................................] duration: 140.025595ms FAIL (2025-08-19 17:57:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 140.046715ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X.....................X...............................] duration: 148.619099ms FAIL (2025-08-19 17:57:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 148.635019ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X....X..........................................] duration: 335.613729ms FAIL (2025-08-19 17:57:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== [seg_pos={0 0}, upload=274520]: Done begin upload segment. Aug 19 17:24:12.024531859 (263h57m52.755799509s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024547178 (263h57m52.755814828s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024953521 (263h57m52.756221171s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024997523 (263h57m52.756265174s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025367439 (263h57m52.756635089s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025414347 (263h57m52.756681997s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025761920 (263h57m52.75702958s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025888298 (263h57m52.757155948s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026138559 (263h57m52.757406208s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026283681 (263h57m52.75755133s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026491962 (263h57m52.757759613s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026640120 (263h57m52.757907771s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026842701 (263h57m52.758110352s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026995178 (263h57m52.758262828s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027210582 (263h57m52.758478232s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027858310 (263h57m52.75912596s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.143746757 (263h57m52.875014407s) [upload=274520]: Next returned nil segment Aug 19 17:24:12.143775502 (263h57m52.875043152s) [upload=274520]: Waiting for error group managing segments... Aug 19 17:24:12.157847553 (263h57m52.889115213s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158547338 (263h57m52.889814989s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158808157 (263h57m52.890075818s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.159159038 (263h57m52.890426688s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.160381044 (263h57m52.891648694s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.163470309 (263h57m52.894737959s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:41.979520414 (263h58m22.710788064s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 5.161.89.252:36766->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980102297 (263h58m22.711369958s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:21646->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980158464 (263h58m22.711426114s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 5.161.89.252:51578->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980204240 (263h58m22.71147189s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 5.161.89.252:9778->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980249345 (263h58m22.711517004s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 5.161.89.252:22472->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980292254 (263h58m22.711559905s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 5.161.89.252:34124->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980365091 (263h58m22.711632752s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 5.161.89.252:8238->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980403213 (263h58m22.711670863s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980547475 (263h58m22.711815124s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 5.161.89.252:29404->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980632083 (263h58m22.711899743s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980736129 (263h58m22.712003779s) [seg_pos={0 0}, upload=274520]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Aug 19 17:24:41.997898729 (263h58m22.729166379s) [upload=274520]: Done uploading segments... Aug 19 17:24:41.997919457 (263h58m22.729187108s) [upload=274520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 335.637623ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X...X.......................................] duration: 407.593384ms FAIL (2025-08-19 17:57:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 407.608824ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.355578155s FAIL (2025-08-19 17:57:21 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 1.355601941s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...............X.X.X.............XX.........................] duration: 686.739267ms FAIL (2025-08-19 17:57:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:35:24.598550906 (264h9m5.329818526s) [upload=274709]: Starting upload Aug 19 17:35:24.598598336 (264h9m5.329865966s) [upload=274709]: Done starting upload Aug 19 17:35:24.598705527 (264h9m5.329973177s) [upload=274709]: Uploading segments... Aug 19 17:35:24.598834049 (264h9m5.330101679s) [upload=274709]: Got next segment. Inline: false Aug 19 17:35:24.598891597 (264h9m5.330159247s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:35:24.598922305 (264h9m5.330189965s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:35:24.622781310 (264h9m5.354048961s) [seg_pos={0 0}, upload=274709]: Begin upload segment... Aug 19 17:35:24.622850871 (264h9m5.35411852s) [seg_pos={0 0}, upload=274709]: Done begin upload segment. Aug 19 17:35:24.622881097 (264h9m5.354148758s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.622915473 (264h9m5.354183093s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623242778 (264h9m5.354510398s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623434598 (264h9m5.354702257s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623465406 (264h9m5.354733026s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623704975 (264h9m5.354972595s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623972749 (264h9m5.355240369s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624046368 (264h9m5.355314018s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624428025 (264h9m5.355695684s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624838907 (264h9m5.356106557s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625410892 (264h9m5.356678542s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625821152 (264h9m5.357088803s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626247935 (264h9m5.357515585s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626718509 (264h9m5.35798616s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627108321 (264h9m5.358375972s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627468548 (264h9m5.358736198s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627964190 (264h9m5.35923184s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.628364072 (264h9m5.359631721s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.722088727 (264h9m5.453356348s) [upload=274709]: Next returned nil segment Aug 19 17:35:24.722132710 (264h9m5.45340033s) [upload=274709]: Waiting for error group managing segments... Aug 19 17:35:24.742673821 (264h9m5.473941441s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.743213144 (264h9m5.474480765s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.744830845 (264h9m5.476098485s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.747023905 (264h9m5.478291526s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.753657211 (264h9m5.484924862s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.754442816 (264h9m5.485710437s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.756549285 (264h9m5.487816925s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.757132692 (264h9m5.488400312s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.758813881 (264h9m5.490081521s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.760553070 (264h9m5.491820689s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.761195576 (264h9m5.492463197s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.762297076 (264h9m5.493564726s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.778979887 (264h9m5.510247517s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785621458 (264h9m5.516889107s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785659460 (264h9m5.5169271s) [seg_pos={0 0}, upload=274709]: Segment reached optimal threshold of 14 pieces. Aug 19 17:35:24.785819780 (264h9m5.51708741s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.785925820 (264h9m5.51719347s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5pHzd3BFgkMPrMhSwTQBSxbSp7khERtcaCbZn1crJobN5zWn): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786017702 (264h9m5.517285332s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786091801 (264h9m5.517359452s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: read tcp 5.161.89.252:57194->66.23.193.175:4559: use of closed network connection; context canceled Aug 19 17:35:24.786125735 (264h9m5.517393385s) [seg_pos={0 0}, upload=274709]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 17:35:24.786208471 (264h9m5.517476122s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 17:35:24.786213561 (264h9m5.517481211s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:35:24.829790861 (264h9m5.56105848s) [upload=274709]: Done uploading segments... Aug 19 17:35:24.829804556 (264h9m5.561072186s) [upload=274709]: Upload finished. err: <nil> Duration: 686.759815ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X.....................X..............................] duration: 148.564005ms FAIL (2025-08-19 17:57:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 148.58233ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 416.431784ms FAIL (2025-08-19 17:57:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== ]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:20:30.724709450 (263h54m11.4559771s) [seg_pos={0 0}, upload=274457]: Begin upload segment... Aug 19 17:20:30.724753462 (263h54m11.456021113s) [seg_pos={0 0}, upload=274457]: Done begin upload segment. Aug 19 17:20:30.724781936 (263h54m11.456049586s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.724797054 (263h54m11.456064674s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725166569 (263h54m11.456434189s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725324816 (263h54m11.456592476s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725415496 (263h54m11.456683126s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725643935 (263h54m11.456911565s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725817342 (263h54m11.457084992s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725853730 (263h54m11.45712136s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725891440 (263h54m11.457159071s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726110873 (263h54m11.457378504s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726322932 (263h54m11.457590582s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726338811 (263h54m11.457606432s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726711522 (263h54m11.457979172s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727114529 (263h54m11.458382178s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727561679 (263h54m11.458829329s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728022655 (263h54m11.459290316s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728544566 (263h54m11.459812225s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728932415 (263h54m11.460200435s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.813701018 (263h54m11.544968628s) [upload=274457]: Next returned nil segment Aug 19 17:20:30.813711287 (263h54m11.544978897s) [upload=274457]: Waiting for error group managing segments... Aug 19 17:20:30.826872026 (263h54m11.558139646s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.832633702 (263h54m11.563901332s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.834038051 (263h54m11.565305681s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.844605367 (263h54m11.575872987s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.864222729 (263h54m11.59549035s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.866711214 (263h54m11.597978835s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.882824352 (263h54m11.614091972s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:31.250301081 (263h54m11.981568741s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:11.439696042 (263h54m52.170963692s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:13.585367789 (263h54m54.316635419s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:16.506635739 (263h54m57.237903369s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:22.880177884 (263h55m3.611445533s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:30.678773057 (263h55m11.410040716s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:14fc8QANkMVxxrHcXTWi1yyDhE2gz8BJNwRuvJNfX56TyQCWYZ, address:45.91.116.7:4032): protocol: rpc: dial tcp 45.91.116.7:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678847767 (263h55m11.410115416s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1yd47We7k2qgmcAVz5DhwZQMfnX71BrmLmtBoYyLn7D8t1psh2, address:45.91.116.12:4238): protocol: read tcp 5.161.89.252:32834->45.91.116.12:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678926845 (263h55m11.410194495s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd, address:77.90.31.21:4890): protocol: rpc: dial tcp 77.90.31.21:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678951581 (263h55m11.410219241s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo, address:77.90.31.18:4829): protocol: rpc: dial tcp 77.90.31.18:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678966439 (263h55m11.410234099s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: write tcp 5.161.89.252:42466->77.90.31.14:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679024038 (263h55m11.410291688s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7, address:45.91.116.10:4107): protocol: read tcp 5.161.89.252:39718->45.91.116.10:4107: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679071326 (263h55m11.410338977s) [seg_pos={0 0}, upload=274457]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 19 17:21:30.694027780 (263h55m11.425295431s) [upload=274457]: Done uploading segments... Aug 19 17:21:30.694046335 (263h55m11.425313986s) [upload=274457]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration:* 416.463423ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.528902549s FAIL (2025-08-19 17:56:55 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 1.529096833s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X.....................X.............................] duration: 2.159527419s FAIL (2025-08-19 17:56:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 2.159553599s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X...X......................................] duration: 469.378567ms FAIL (2025-08-19 17:56:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 469.398234ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X....X.........................................] duration: 535.7766ms FAIL (2025-08-19 17:56:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== [seg_pos={0 0}, upload=274520]: Done begin upload segment. Aug 19 17:24:12.024531859 (263h57m52.755799509s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024547178 (263h57m52.755814828s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024953521 (263h57m52.756221171s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024997523 (263h57m52.756265174s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025367439 (263h57m52.756635089s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025414347 (263h57m52.756681997s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025761920 (263h57m52.75702958s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025888298 (263h57m52.757155948s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026138559 (263h57m52.757406208s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026283681 (263h57m52.75755133s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026491962 (263h57m52.757759613s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026640120 (263h57m52.757907771s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026842701 (263h57m52.758110352s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026995178 (263h57m52.758262828s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027210582 (263h57m52.758478232s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027858310 (263h57m52.75912596s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.143746757 (263h57m52.875014407s) [upload=274520]: Next returned nil segment Aug 19 17:24:12.143775502 (263h57m52.875043152s) [upload=274520]: Waiting for error group managing segments... Aug 19 17:24:12.157847553 (263h57m52.889115213s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158547338 (263h57m52.889814989s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158808157 (263h57m52.890075818s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.159159038 (263h57m52.890426688s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.160381044 (263h57m52.891648694s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.163470309 (263h57m52.894737959s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:41.979520414 (263h58m22.710788064s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 5.161.89.252:36766->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980102297 (263h58m22.711369958s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:21646->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980158464 (263h58m22.711426114s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 5.161.89.252:51578->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980204240 (263h58m22.71147189s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 5.161.89.252:9778->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980249345 (263h58m22.711517004s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 5.161.89.252:22472->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980292254 (263h58m22.711559905s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 5.161.89.252:34124->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980365091 (263h58m22.711632752s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 5.161.89.252:8238->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980403213 (263h58m22.711670863s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980547475 (263h58m22.711815124s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 5.161.89.252:29404->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980632083 (263h58m22.711899743s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980736129 (263h58m22.712003779s) [seg_pos={0 0}, upload=274520]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Aug 19 17:24:41.997898729 (263h58m22.729166379s) [upload=274520]: Done uploading segments... Aug 19 17:24:41.997919457 (263h58m22.729187108s) [upload=274520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 535.801759ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [................X.X.X.............XX........................] duration: 526.926335ms FAIL (2025-08-19 17:56:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:35:24.598550906 (264h9m5.329818526s) [upload=274709]: Starting upload Aug 19 17:35:24.598598336 (264h9m5.329865966s) [upload=274709]: Done starting upload Aug 19 17:35:24.598705527 (264h9m5.329973177s) [upload=274709]: Uploading segments... Aug 19 17:35:24.598834049 (264h9m5.330101679s) [upload=274709]: Got next segment. Inline: false Aug 19 17:35:24.598891597 (264h9m5.330159247s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:35:24.598922305 (264h9m5.330189965s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:35:24.622781310 (264h9m5.354048961s) [seg_pos={0 0}, upload=274709]: Begin upload segment... Aug 19 17:35:24.622850871 (264h9m5.35411852s) [seg_pos={0 0}, upload=274709]: Done begin upload segment. Aug 19 17:35:24.622881097 (264h9m5.354148758s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.622915473 (264h9m5.354183093s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623242778 (264h9m5.354510398s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623434598 (264h9m5.354702257s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623465406 (264h9m5.354733026s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623704975 (264h9m5.354972595s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623972749 (264h9m5.355240369s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624046368 (264h9m5.355314018s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624428025 (264h9m5.355695684s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624838907 (264h9m5.356106557s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625410892 (264h9m5.356678542s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625821152 (264h9m5.357088803s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626247935 (264h9m5.357515585s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626718509 (264h9m5.35798616s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627108321 (264h9m5.358375972s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627468548 (264h9m5.358736198s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627964190 (264h9m5.35923184s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.628364072 (264h9m5.359631721s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.722088727 (264h9m5.453356348s) [upload=274709]: Next returned nil segment Aug 19 17:35:24.722132710 (264h9m5.45340033s) [upload=274709]: Waiting for error group managing segments... Aug 19 17:35:24.742673821 (264h9m5.473941441s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.743213144 (264h9m5.474480765s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.744830845 (264h9m5.476098485s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.747023905 (264h9m5.478291526s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.753657211 (264h9m5.484924862s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.754442816 (264h9m5.485710437s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.756549285 (264h9m5.487816925s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.757132692 (264h9m5.488400312s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.758813881 (264h9m5.490081521s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.760553070 (264h9m5.491820689s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.761195576 (264h9m5.492463197s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.762297076 (264h9m5.493564726s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.778979887 (264h9m5.510247517s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785621458 (264h9m5.516889107s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785659460 (264h9m5.5169271s) [seg_pos={0 0}, upload=274709]: Segment reached optimal threshold of 14 pieces. Aug 19 17:35:24.785819780 (264h9m5.51708741s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.785925820 (264h9m5.51719347s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5pHzd3BFgkMPrMhSwTQBSxbSp7khERtcaCbZn1crJobN5zWn): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786017702 (264h9m5.517285332s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786091801 (264h9m5.517359452s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: read tcp 5.161.89.252:57194->66.23.193.175:4559: use of closed network connection; context canceled Aug 19 17:35:24.786125735 (264h9m5.517393385s) [seg_pos={0 0}, upload=274709]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 17:35:24.786208471 (264h9m5.517476122s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 17:35:24.786213561 (264h9m5.517481211s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:35:24.829790861 (264h9m5.56105848s) [upload=274709]: Done uploading segments... Aug 19 17:35:24.829804556 (264h9m5.561072186s) [upload=274709]: Upload finished. err: <nil> Duration: 526.995977ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X.....................X............................] duration: 224.479588ms FAIL (2025-08-19 17:56:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 224.537798ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 536.320254ms FAIL (2025-08-19 17:56:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== ]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:20:30.724709450 (263h54m11.4559771s) [seg_pos={0 0}, upload=274457]: Begin upload segment... Aug 19 17:20:30.724753462 (263h54m11.456021113s) [seg_pos={0 0}, upload=274457]: Done begin upload segment. Aug 19 17:20:30.724781936 (263h54m11.456049586s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.724797054 (263h54m11.456064674s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725166569 (263h54m11.456434189s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725324816 (263h54m11.456592476s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725415496 (263h54m11.456683126s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725643935 (263h54m11.456911565s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725817342 (263h54m11.457084992s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725853730 (263h54m11.45712136s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725891440 (263h54m11.457159071s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726110873 (263h54m11.457378504s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726322932 (263h54m11.457590582s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726338811 (263h54m11.457606432s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726711522 (263h54m11.457979172s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727114529 (263h54m11.458382178s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727561679 (263h54m11.458829329s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728022655 (263h54m11.459290316s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728544566 (263h54m11.459812225s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728932415 (263h54m11.460200435s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.813701018 (263h54m11.544968628s) [upload=274457]: Next returned nil segment Aug 19 17:20:30.813711287 (263h54m11.544978897s) [upload=274457]: Waiting for error group managing segments... Aug 19 17:20:30.826872026 (263h54m11.558139646s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.832633702 (263h54m11.563901332s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.834038051 (263h54m11.565305681s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.844605367 (263h54m11.575872987s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.864222729 (263h54m11.59549035s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.866711214 (263h54m11.597978835s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.882824352 (263h54m11.614091972s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:31.250301081 (263h54m11.981568741s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:11.439696042 (263h54m52.170963692s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:13.585367789 (263h54m54.316635419s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:16.506635739 (263h54m57.237903369s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:22.880177884 (263h55m3.611445533s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:30.678773057 (263h55m11.410040716s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:14fc8QANkMVxxrHcXTWi1yyDhE2gz8BJNwRuvJNfX56TyQCWYZ, address:45.91.116.7:4032): protocol: rpc: dial tcp 45.91.116.7:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678847767 (263h55m11.410115416s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1yd47We7k2qgmcAVz5DhwZQMfnX71BrmLmtBoYyLn7D8t1psh2, address:45.91.116.12:4238): protocol: read tcp 5.161.89.252:32834->45.91.116.12:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678926845 (263h55m11.410194495s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd, address:77.90.31.21:4890): protocol: rpc: dial tcp 77.90.31.21:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678951581 (263h55m11.410219241s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo, address:77.90.31.18:4829): protocol: rpc: dial tcp 77.90.31.18:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678966439 (263h55m11.410234099s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: write tcp 5.161.89.252:42466->77.90.31.14:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679024038 (263h55m11.410291688s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7, address:45.91.116.10:4107): protocol: read tcp 5.161.89.252:39718->45.91.116.10:4107: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679071326 (263h55m11.410338977s) [seg_pos={0 0}, upload=274457]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 19 17:21:30.694027780 (263h55m11.425295431s) [upload=274457]: Done uploading segments... Aug 19 17:21:30.694046335 (263h55m11.425313986s) [upload=274457]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration:* 536.369927ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.485074608s FAIL (2025-08-19 17:55:53 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 1.485101549s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 400.063901ms FAIL (2025-08-19 17:55:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== ]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:20:30.724709450 (263h54m11.4559771s) [seg_pos={0 0}, upload=274457]: Begin upload segment... Aug 19 17:20:30.724753462 (263h54m11.456021113s) [seg_pos={0 0}, upload=274457]: Done begin upload segment. Aug 19 17:20:30.724781936 (263h54m11.456049586s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.724797054 (263h54m11.456064674s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725166569 (263h54m11.456434189s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725324816 (263h54m11.456592476s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725415496 (263h54m11.456683126s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725643935 (263h54m11.456911565s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725817342 (263h54m11.457084992s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725853730 (263h54m11.45712136s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725891440 (263h54m11.457159071s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726110873 (263h54m11.457378504s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726322932 (263h54m11.457590582s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726338811 (263h54m11.457606432s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726711522 (263h54m11.457979172s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727114529 (263h54m11.458382178s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727561679 (263h54m11.458829329s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728022655 (263h54m11.459290316s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728544566 (263h54m11.459812225s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728932415 (263h54m11.460200435s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.813701018 (263h54m11.544968628s) [upload=274457]: Next returned nil segment Aug 19 17:20:30.813711287 (263h54m11.544978897s) [upload=274457]: Waiting for error group managing segments... Aug 19 17:20:30.826872026 (263h54m11.558139646s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.832633702 (263h54m11.563901332s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.834038051 (263h54m11.565305681s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.844605367 (263h54m11.575872987s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.864222729 (263h54m11.59549035s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.866711214 (263h54m11.597978835s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.882824352 (263h54m11.614091972s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:31.250301081 (263h54m11.981568741s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:11.439696042 (263h54m52.170963692s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:13.585367789 (263h54m54.316635419s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:16.506635739 (263h54m57.237903369s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:22.880177884 (263h55m3.611445533s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:30.678773057 (263h55m11.410040716s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:14fc8QANkMVxxrHcXTWi1yyDhE2gz8BJNwRuvJNfX56TyQCWYZ, address:45.91.116.7:4032): protocol: rpc: dial tcp 45.91.116.7:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678847767 (263h55m11.410115416s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1yd47We7k2qgmcAVz5DhwZQMfnX71BrmLmtBoYyLn7D8t1psh2, address:45.91.116.12:4238): protocol: read tcp 5.161.89.252:32834->45.91.116.12:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678926845 (263h55m11.410194495s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd, address:77.90.31.21:4890): protocol: rpc: dial tcp 77.90.31.21:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678951581 (263h55m11.410219241s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo, address:77.90.31.18:4829): protocol: rpc: dial tcp 77.90.31.18:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678966439 (263h55m11.410234099s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: write tcp 5.161.89.252:42466->77.90.31.14:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679024038 (263h55m11.410291688s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7, address:45.91.116.10:4107): protocol: read tcp 5.161.89.252:39718->45.91.116.10:4107: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679071326 (263h55m11.410338977s) [seg_pos={0 0}, upload=274457]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 19 17:21:30.694027780 (263h55m11.425295431s) [upload=274457]: Done uploading segments... Aug 19 17:21:30.694046335 (263h55m11.425313986s) [upload=274457]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration:* 400.098135ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X...X.....................................] duration: 338.235998ms FAIL (2025-08-19 17:55:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 338.252509ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X....X........................................] duration: 347.247768ms FAIL (2025-08-19 17:55:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== [seg_pos={0 0}, upload=274520]: Done begin upload segment. Aug 19 17:24:12.024531859 (263h57m52.755799509s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024547178 (263h57m52.755814828s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024953521 (263h57m52.756221171s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024997523 (263h57m52.756265174s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025367439 (263h57m52.756635089s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025414347 (263h57m52.756681997s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025761920 (263h57m52.75702958s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025888298 (263h57m52.757155948s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026138559 (263h57m52.757406208s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026283681 (263h57m52.75755133s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026491962 (263h57m52.757759613s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026640120 (263h57m52.757907771s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026842701 (263h57m52.758110352s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026995178 (263h57m52.758262828s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027210582 (263h57m52.758478232s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027858310 (263h57m52.75912596s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.143746757 (263h57m52.875014407s) [upload=274520]: Next returned nil segment Aug 19 17:24:12.143775502 (263h57m52.875043152s) [upload=274520]: Waiting for error group managing segments... Aug 19 17:24:12.157847553 (263h57m52.889115213s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158547338 (263h57m52.889814989s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158808157 (263h57m52.890075818s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.159159038 (263h57m52.890426688s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.160381044 (263h57m52.891648694s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.163470309 (263h57m52.894737959s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:41.979520414 (263h58m22.710788064s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 5.161.89.252:36766->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980102297 (263h58m22.711369958s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:21646->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980158464 (263h58m22.711426114s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 5.161.89.252:51578->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980204240 (263h58m22.71147189s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 5.161.89.252:9778->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980249345 (263h58m22.711517004s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 5.161.89.252:22472->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980292254 (263h58m22.711559905s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 5.161.89.252:34124->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980365091 (263h58m22.711632752s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 5.161.89.252:8238->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980403213 (263h58m22.711670863s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980547475 (263h58m22.711815124s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 5.161.89.252:29404->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980632083 (263h58m22.711899743s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980736129 (263h58m22.712003779s) [seg_pos={0 0}, upload=274520]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Aug 19 17:24:41.997898729 (263h58m22.729166379s) [upload=274520]: Done uploading segments... Aug 19 17:24:41.997919457 (263h58m22.729187108s) [upload=274520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 347.268888ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X.....................X...........................] duration: 378.600688ms FAIL (2025-08-19 17:55:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 378.628401ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 449.24288ms FAIL (2025-08-19 17:55:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== ]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:20:30.724709450 (263h54m11.4559771s) [seg_pos={0 0}, upload=274457]: Begin upload segment... Aug 19 17:20:30.724753462 (263h54m11.456021113s) [seg_pos={0 0}, upload=274457]: Done begin upload segment. Aug 19 17:20:30.724781936 (263h54m11.456049586s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.724797054 (263h54m11.456064674s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725166569 (263h54m11.456434189s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725324816 (263h54m11.456592476s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725415496 (263h54m11.456683126s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725643935 (263h54m11.456911565s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725817342 (263h54m11.457084992s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725853730 (263h54m11.45712136s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725891440 (263h54m11.457159071s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726110873 (263h54m11.457378504s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726322932 (263h54m11.457590582s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726338811 (263h54m11.457606432s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726711522 (263h54m11.457979172s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727114529 (263h54m11.458382178s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727561679 (263h54m11.458829329s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728022655 (263h54m11.459290316s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728544566 (263h54m11.459812225s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728932415 (263h54m11.460200435s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.813701018 (263h54m11.544968628s) [upload=274457]: Next returned nil segment Aug 19 17:20:30.813711287 (263h54m11.544978897s) [upload=274457]: Waiting for error group managing segments... Aug 19 17:20:30.826872026 (263h54m11.558139646s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.832633702 (263h54m11.563901332s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.834038051 (263h54m11.565305681s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.844605367 (263h54m11.575872987s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.864222729 (263h54m11.59549035s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.866711214 (263h54m11.597978835s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.882824352 (263h54m11.614091972s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:31.250301081 (263h54m11.981568741s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:11.439696042 (263h54m52.170963692s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:13.585367789 (263h54m54.316635419s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:16.506635739 (263h54m57.237903369s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:22.880177884 (263h55m3.611445533s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:30.678773057 (263h55m11.410040716s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:14fc8QANkMVxxrHcXTWi1yyDhE2gz8BJNwRuvJNfX56TyQCWYZ, address:45.91.116.7:4032): protocol: rpc: dial tcp 45.91.116.7:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678847767 (263h55m11.410115416s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1yd47We7k2qgmcAVz5DhwZQMfnX71BrmLmtBoYyLn7D8t1psh2, address:45.91.116.12:4238): protocol: read tcp 5.161.89.252:32834->45.91.116.12:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678926845 (263h55m11.410194495s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd, address:77.90.31.21:4890): protocol: rpc: dial tcp 77.90.31.21:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678951581 (263h55m11.410219241s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo, address:77.90.31.18:4829): protocol: rpc: dial tcp 77.90.31.18:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678966439 (263h55m11.410234099s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: write tcp 5.161.89.252:42466->77.90.31.14:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679024038 (263h55m11.410291688s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7, address:45.91.116.10:4107): protocol: read tcp 5.161.89.252:39718->45.91.116.10:4107: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679071326 (263h55m11.410338977s) [seg_pos={0 0}, upload=274457]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 19 17:21:30.694027780 (263h55m11.425295431s) [upload=274457]: Done uploading segments... Aug 19 17:21:30.694046335 (263h55m11.425313986s) [upload=274457]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration:* 449.266445ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.................X.X.X.............XX.......................] duration: 515.461627ms FAIL (2025-08-19 17:55:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:35:24.598550906 (264h9m5.329818526s) [upload=274709]: Starting upload Aug 19 17:35:24.598598336 (264h9m5.329865966s) [upload=274709]: Done starting upload Aug 19 17:35:24.598705527 (264h9m5.329973177s) [upload=274709]: Uploading segments... Aug 19 17:35:24.598834049 (264h9m5.330101679s) [upload=274709]: Got next segment. Inline: false Aug 19 17:35:24.598891597 (264h9m5.330159247s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:35:24.598922305 (264h9m5.330189965s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:35:24.622781310 (264h9m5.354048961s) [seg_pos={0 0}, upload=274709]: Begin upload segment... Aug 19 17:35:24.622850871 (264h9m5.35411852s) [seg_pos={0 0}, upload=274709]: Done begin upload segment. Aug 19 17:35:24.622881097 (264h9m5.354148758s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.622915473 (264h9m5.354183093s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623242778 (264h9m5.354510398s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623434598 (264h9m5.354702257s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623465406 (264h9m5.354733026s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623704975 (264h9m5.354972595s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623972749 (264h9m5.355240369s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624046368 (264h9m5.355314018s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624428025 (264h9m5.355695684s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624838907 (264h9m5.356106557s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625410892 (264h9m5.356678542s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625821152 (264h9m5.357088803s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626247935 (264h9m5.357515585s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626718509 (264h9m5.35798616s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627108321 (264h9m5.358375972s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627468548 (264h9m5.358736198s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627964190 (264h9m5.35923184s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.628364072 (264h9m5.359631721s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.722088727 (264h9m5.453356348s) [upload=274709]: Next returned nil segment Aug 19 17:35:24.722132710 (264h9m5.45340033s) [upload=274709]: Waiting for error group managing segments... Aug 19 17:35:24.742673821 (264h9m5.473941441s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.743213144 (264h9m5.474480765s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.744830845 (264h9m5.476098485s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.747023905 (264h9m5.478291526s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.753657211 (264h9m5.484924862s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.754442816 (264h9m5.485710437s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.756549285 (264h9m5.487816925s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.757132692 (264h9m5.488400312s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.758813881 (264h9m5.490081521s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.760553070 (264h9m5.491820689s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.761195576 (264h9m5.492463197s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.762297076 (264h9m5.493564726s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.778979887 (264h9m5.510247517s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785621458 (264h9m5.516889107s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785659460 (264h9m5.5169271s) [seg_pos={0 0}, upload=274709]: Segment reached optimal threshold of 14 pieces. Aug 19 17:35:24.785819780 (264h9m5.51708741s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.785925820 (264h9m5.51719347s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5pHzd3BFgkMPrMhSwTQBSxbSp7khERtcaCbZn1crJobN5zWn): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786017702 (264h9m5.517285332s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786091801 (264h9m5.517359452s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: read tcp 5.161.89.252:57194->66.23.193.175:4559: use of closed network connection; context canceled Aug 19 17:35:24.786125735 (264h9m5.517393385s) [seg_pos={0 0}, upload=274709]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 17:35:24.786208471 (264h9m5.517476122s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 17:35:24.786213561 (264h9m5.517481211s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:35:24.829790861 (264h9m5.56105848s) [upload=274709]: Done uploading segments... Aug 19 17:35:24.829804556 (264h9m5.561072186s) [upload=274709]: Upload finished. err: <nil> Duration: 515.478759ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.322382027s FAIL (2025-08-19 17:54:46 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 1.322408155s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X.....................X..........................] duration: 159.51522ms FAIL (2025-08-19 17:54:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 159.534975ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X...X....................................] duration: 366.847617ms FAIL (2025-08-19 17:54:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 366.864018ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X....X.......................................] duration: 417.806585ms FAIL (2025-08-19 17:54:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== [seg_pos={0 0}, upload=274520]: Done begin upload segment. Aug 19 17:24:12.024531859 (263h57m52.755799509s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024547178 (263h57m52.755814828s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024953521 (263h57m52.756221171s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024997523 (263h57m52.756265174s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025367439 (263h57m52.756635089s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025414347 (263h57m52.756681997s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025761920 (263h57m52.75702958s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025888298 (263h57m52.757155948s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026138559 (263h57m52.757406208s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026283681 (263h57m52.75755133s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026491962 (263h57m52.757759613s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026640120 (263h57m52.757907771s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026842701 (263h57m52.758110352s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026995178 (263h57m52.758262828s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027210582 (263h57m52.758478232s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027858310 (263h57m52.75912596s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.143746757 (263h57m52.875014407s) [upload=274520]: Next returned nil segment Aug 19 17:24:12.143775502 (263h57m52.875043152s) [upload=274520]: Waiting for error group managing segments... Aug 19 17:24:12.157847553 (263h57m52.889115213s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158547338 (263h57m52.889814989s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158808157 (263h57m52.890075818s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.159159038 (263h57m52.890426688s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.160381044 (263h57m52.891648694s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.163470309 (263h57m52.894737959s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:41.979520414 (263h58m22.710788064s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 5.161.89.252:36766->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980102297 (263h58m22.711369958s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:21646->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980158464 (263h58m22.711426114s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 5.161.89.252:51578->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980204240 (263h58m22.71147189s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 5.161.89.252:9778->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980249345 (263h58m22.711517004s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 5.161.89.252:22472->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980292254 (263h58m22.711559905s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 5.161.89.252:34124->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980365091 (263h58m22.711632752s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 5.161.89.252:8238->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980403213 (263h58m22.711670863s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980547475 (263h58m22.711815124s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 5.161.89.252:29404->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980632083 (263h58m22.711899743s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980736129 (263h58m22.712003779s) [seg_pos={0 0}, upload=274520]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Aug 19 17:24:41.997898729 (263h58m22.729166379s) [upload=274520]: Done uploading segments... Aug 19 17:24:41.997919457 (263h58m22.729187108s) [upload=274520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 417.83077ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.318531764s FAIL (2025-08-19 17:54:23 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 1.318553476s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 398.330354ms FAIL (2025-08-19 17:54:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== ]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:20:30.724709450 (263h54m11.4559771s) [seg_pos={0 0}, upload=274457]: Begin upload segment... Aug 19 17:20:30.724753462 (263h54m11.456021113s) [seg_pos={0 0}, upload=274457]: Done begin upload segment. Aug 19 17:20:30.724781936 (263h54m11.456049586s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.724797054 (263h54m11.456064674s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725166569 (263h54m11.456434189s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725324816 (263h54m11.456592476s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725415496 (263h54m11.456683126s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725643935 (263h54m11.456911565s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725817342 (263h54m11.457084992s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725853730 (263h54m11.45712136s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725891440 (263h54m11.457159071s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726110873 (263h54m11.457378504s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726322932 (263h54m11.457590582s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726338811 (263h54m11.457606432s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726711522 (263h54m11.457979172s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727114529 (263h54m11.458382178s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727561679 (263h54m11.458829329s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728022655 (263h54m11.459290316s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728544566 (263h54m11.459812225s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728932415 (263h54m11.460200435s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.813701018 (263h54m11.544968628s) [upload=274457]: Next returned nil segment Aug 19 17:20:30.813711287 (263h54m11.544978897s) [upload=274457]: Waiting for error group managing segments... Aug 19 17:20:30.826872026 (263h54m11.558139646s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.832633702 (263h54m11.563901332s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.834038051 (263h54m11.565305681s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.844605367 (263h54m11.575872987s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.864222729 (263h54m11.59549035s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.866711214 (263h54m11.597978835s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.882824352 (263h54m11.614091972s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:31.250301081 (263h54m11.981568741s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:11.439696042 (263h54m52.170963692s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:13.585367789 (263h54m54.316635419s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:16.506635739 (263h54m57.237903369s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:22.880177884 (263h55m3.611445533s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:30.678773057 (263h55m11.410040716s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:14fc8QANkMVxxrHcXTWi1yyDhE2gz8BJNwRuvJNfX56TyQCWYZ, address:45.91.116.7:4032): protocol: rpc: dial tcp 45.91.116.7:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678847767 (263h55m11.410115416s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1yd47We7k2qgmcAVz5DhwZQMfnX71BrmLmtBoYyLn7D8t1psh2, address:45.91.116.12:4238): protocol: read tcp 5.161.89.252:32834->45.91.116.12:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678926845 (263h55m11.410194495s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd, address:77.90.31.21:4890): protocol: rpc: dial tcp 77.90.31.21:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678951581 (263h55m11.410219241s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo, address:77.90.31.18:4829): protocol: rpc: dial tcp 77.90.31.18:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678966439 (263h55m11.410234099s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: write tcp 5.161.89.252:42466->77.90.31.14:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679024038 (263h55m11.410291688s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7, address:45.91.116.10:4107): protocol: read tcp 5.161.89.252:39718->45.91.116.10:4107: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679071326 (263h55m11.410338977s) [seg_pos={0 0}, upload=274457]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 19 17:21:30.694027780 (263h55m11.425295431s) [upload=274457]: Done uploading segments... Aug 19 17:21:30.694046335 (263h55m11.425313986s) [upload=274457]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration:* 398.356654ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..................X.X.X.............XX......................] duration: 600.082614ms FAIL (2025-08-19 17:54:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:35:24.598550906 (264h9m5.329818526s) [upload=274709]: Starting upload Aug 19 17:35:24.598598336 (264h9m5.329865966s) [upload=274709]: Done starting upload Aug 19 17:35:24.598705527 (264h9m5.329973177s) [upload=274709]: Uploading segments... Aug 19 17:35:24.598834049 (264h9m5.330101679s) [upload=274709]: Got next segment. Inline: false Aug 19 17:35:24.598891597 (264h9m5.330159247s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:35:24.598922305 (264h9m5.330189965s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:35:24.622781310 (264h9m5.354048961s) [seg_pos={0 0}, upload=274709]: Begin upload segment... Aug 19 17:35:24.622850871 (264h9m5.35411852s) [seg_pos={0 0}, upload=274709]: Done begin upload segment. Aug 19 17:35:24.622881097 (264h9m5.354148758s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.622915473 (264h9m5.354183093s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623242778 (264h9m5.354510398s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623434598 (264h9m5.354702257s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623465406 (264h9m5.354733026s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623704975 (264h9m5.354972595s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623972749 (264h9m5.355240369s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624046368 (264h9m5.355314018s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624428025 (264h9m5.355695684s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624838907 (264h9m5.356106557s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625410892 (264h9m5.356678542s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625821152 (264h9m5.357088803s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626247935 (264h9m5.357515585s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626718509 (264h9m5.35798616s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627108321 (264h9m5.358375972s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627468548 (264h9m5.358736198s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627964190 (264h9m5.35923184s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.628364072 (264h9m5.359631721s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.722088727 (264h9m5.453356348s) [upload=274709]: Next returned nil segment Aug 19 17:35:24.722132710 (264h9m5.45340033s) [upload=274709]: Waiting for error group managing segments... Aug 19 17:35:24.742673821 (264h9m5.473941441s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.743213144 (264h9m5.474480765s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.744830845 (264h9m5.476098485s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.747023905 (264h9m5.478291526s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.753657211 (264h9m5.484924862s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.754442816 (264h9m5.485710437s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.756549285 (264h9m5.487816925s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.757132692 (264h9m5.488400312s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.758813881 (264h9m5.490081521s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.760553070 (264h9m5.491820689s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.761195576 (264h9m5.492463197s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.762297076 (264h9m5.493564726s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.778979887 (264h9m5.510247517s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785621458 (264h9m5.516889107s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785659460 (264h9m5.5169271s) [seg_pos={0 0}, upload=274709]: Segment reached optimal threshold of 14 pieces. Aug 19 17:35:24.785819780 (264h9m5.51708741s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.785925820 (264h9m5.51719347s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5pHzd3BFgkMPrMhSwTQBSxbSp7khERtcaCbZn1crJobN5zWn): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786017702 (264h9m5.517285332s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786091801 (264h9m5.517359452s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: read tcp 5.161.89.252:57194->66.23.193.175:4559: use of closed network connection; context canceled Aug 19 17:35:24.786125735 (264h9m5.517393385s) [seg_pos={0 0}, upload=274709]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 17:35:24.786208471 (264h9m5.517476122s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 17:35:24.786213561 (264h9m5.517481211s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:35:24.829790861 (264h9m5.56105848s) [upload=274709]: Done uploading segments... Aug 19 17:35:24.829804556 (264h9m5.561072186s) [upload=274709]: Upload finished. err: <nil> Duration: 600.114133ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X....X......................................] duration: 375.649261ms FAIL (2025-08-19 17:53:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== [seg_pos={0 0}, upload=274520]: Done begin upload segment. Aug 19 17:24:12.024531859 (263h57m52.755799509s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024547178 (263h57m52.755814828s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024953521 (263h57m52.756221171s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024997523 (263h57m52.756265174s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025367439 (263h57m52.756635089s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025414347 (263h57m52.756681997s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025761920 (263h57m52.75702958s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025888298 (263h57m52.757155948s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026138559 (263h57m52.757406208s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026283681 (263h57m52.75755133s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026491962 (263h57m52.757759613s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026640120 (263h57m52.757907771s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026842701 (263h57m52.758110352s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026995178 (263h57m52.758262828s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027210582 (263h57m52.758478232s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027858310 (263h57m52.75912596s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.143746757 (263h57m52.875014407s) [upload=274520]: Next returned nil segment Aug 19 17:24:12.143775502 (263h57m52.875043152s) [upload=274520]: Waiting for error group managing segments... Aug 19 17:24:12.157847553 (263h57m52.889115213s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158547338 (263h57m52.889814989s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158808157 (263h57m52.890075818s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.159159038 (263h57m52.890426688s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.160381044 (263h57m52.891648694s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.163470309 (263h57m52.894737959s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:41.979520414 (263h58m22.710788064s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 5.161.89.252:36766->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980102297 (263h58m22.711369958s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:21646->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980158464 (263h58m22.711426114s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 5.161.89.252:51578->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980204240 (263h58m22.71147189s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 5.161.89.252:9778->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980249345 (263h58m22.711517004s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 5.161.89.252:22472->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980292254 (263h58m22.711559905s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 5.161.89.252:34124->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980365091 (263h58m22.711632752s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 5.161.89.252:8238->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980403213 (263h58m22.711670863s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980547475 (263h58m22.711815124s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 5.161.89.252:29404->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980632083 (263h58m22.711899743s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980736129 (263h58m22.712003779s) [seg_pos={0 0}, upload=274520]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Aug 19 17:24:41.997898729 (263h58m22.729166379s) [upload=274520]: Done uploading segments... Aug 19 17:24:41.997919457 (263h58m22.729187108s) [upload=274520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 375.66985ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X...........X.....................X.........................] duration: 165.926139ms FAIL (2025-08-19 17:53:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 165.947408ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X...X...................................] duration: 575.384217ms FAIL (2025-08-19 17:53:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 575.401911ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.315065966s FAIL (2025-08-19 17:53:40 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 1.31508973s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration: 347.794386ms FAIL (2025-08-19 17:53:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 347.810816ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.805403236s FAIL (2025-08-19 17:53:11 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 1.805426951s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X....X.....................................] duration: 431.844316ms FAIL (2025-08-19 17:53:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== [seg_pos={0 0}, upload=274520]: Done begin upload segment. Aug 19 17:24:12.024531859 (263h57m52.755799509s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024547178 (263h57m52.755814828s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024953521 (263h57m52.756221171s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024997523 (263h57m52.756265174s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025367439 (263h57m52.756635089s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025414347 (263h57m52.756681997s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025761920 (263h57m52.75702958s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025888298 (263h57m52.757155948s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026138559 (263h57m52.757406208s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026283681 (263h57m52.75755133s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026491962 (263h57m52.757759613s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026640120 (263h57m52.757907771s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026842701 (263h57m52.758110352s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026995178 (263h57m52.758262828s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027210582 (263h57m52.758478232s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027858310 (263h57m52.75912596s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.143746757 (263h57m52.875014407s) [upload=274520]: Next returned nil segment Aug 19 17:24:12.143775502 (263h57m52.875043152s) [upload=274520]: Waiting for error group managing segments... Aug 19 17:24:12.157847553 (263h57m52.889115213s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158547338 (263h57m52.889814989s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158808157 (263h57m52.890075818s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.159159038 (263h57m52.890426688s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.160381044 (263h57m52.891648694s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.163470309 (263h57m52.894737959s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:41.979520414 (263h58m22.710788064s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 5.161.89.252:36766->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980102297 (263h58m22.711369958s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:21646->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980158464 (263h58m22.711426114s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 5.161.89.252:51578->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980204240 (263h58m22.71147189s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 5.161.89.252:9778->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980249345 (263h58m22.711517004s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 5.161.89.252:22472->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980292254 (263h58m22.711559905s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 5.161.89.252:34124->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980365091 (263h58m22.711632752s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 5.161.89.252:8238->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980403213 (263h58m22.711670863s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980547475 (263h58m22.711815124s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 5.161.89.252:29404->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980632083 (263h58m22.711899743s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980736129 (263h58m22.712003779s) [seg_pos={0 0}, upload=274520]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Aug 19 17:24:41.997898729 (263h58m22.729166379s) [upload=274520]: Done uploading segments... Aug 19 17:24:41.997919457 (263h58m22.729187108s) [upload=274520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 431.87227ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...................X.X.X.............XX.....................] duration: 450.265955ms FAIL (2025-08-19 17:53:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:35:24.598550906 (264h9m5.329818526s) [upload=274709]: Starting upload Aug 19 17:35:24.598598336 (264h9m5.329865966s) [upload=274709]: Done starting upload Aug 19 17:35:24.598705527 (264h9m5.329973177s) [upload=274709]: Uploading segments... Aug 19 17:35:24.598834049 (264h9m5.330101679s) [upload=274709]: Got next segment. Inline: false Aug 19 17:35:24.598891597 (264h9m5.330159247s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:35:24.598922305 (264h9m5.330189965s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:35:24.622781310 (264h9m5.354048961s) [seg_pos={0 0}, upload=274709]: Begin upload segment... Aug 19 17:35:24.622850871 (264h9m5.35411852s) [seg_pos={0 0}, upload=274709]: Done begin upload segment. Aug 19 17:35:24.622881097 (264h9m5.354148758s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.622915473 (264h9m5.354183093s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623242778 (264h9m5.354510398s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623434598 (264h9m5.354702257s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623465406 (264h9m5.354733026s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623704975 (264h9m5.354972595s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623972749 (264h9m5.355240369s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624046368 (264h9m5.355314018s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624428025 (264h9m5.355695684s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624838907 (264h9m5.356106557s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625410892 (264h9m5.356678542s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625821152 (264h9m5.357088803s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626247935 (264h9m5.357515585s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626718509 (264h9m5.35798616s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627108321 (264h9m5.358375972s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627468548 (264h9m5.358736198s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627964190 (264h9m5.35923184s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.628364072 (264h9m5.359631721s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.722088727 (264h9m5.453356348s) [upload=274709]: Next returned nil segment Aug 19 17:35:24.722132710 (264h9m5.45340033s) [upload=274709]: Waiting for error group managing segments... Aug 19 17:35:24.742673821 (264h9m5.473941441s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.743213144 (264h9m5.474480765s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.744830845 (264h9m5.476098485s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.747023905 (264h9m5.478291526s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.753657211 (264h9m5.484924862s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.754442816 (264h9m5.485710437s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.756549285 (264h9m5.487816925s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.757132692 (264h9m5.488400312s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.758813881 (264h9m5.490081521s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.760553070 (264h9m5.491820689s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.761195576 (264h9m5.492463197s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.762297076 (264h9m5.493564726s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.778979887 (264h9m5.510247517s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785621458 (264h9m5.516889107s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785659460 (264h9m5.5169271s) [seg_pos={0 0}, upload=274709]: Segment reached optimal threshold of 14 pieces. Aug 19 17:35:24.785819780 (264h9m5.51708741s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.785925820 (264h9m5.51719347s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5pHzd3BFgkMPrMhSwTQBSxbSp7khERtcaCbZn1crJobN5zWn): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786017702 (264h9m5.517285332s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786091801 (264h9m5.517359452s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: read tcp 5.161.89.252:57194->66.23.193.175:4559: use of closed network connection; context canceled Aug 19 17:35:24.786125735 (264h9m5.517393385s) [seg_pos={0 0}, upload=274709]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 17:35:24.786208471 (264h9m5.517476122s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 17:35:24.786213561 (264h9m5.517481211s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:35:24.829790861 (264h9m5.56105848s) [upload=274709]: Done uploading segments... Aug 19 17:35:24.829804556 (264h9m5.561072186s) [upload=274709]: Upload finished. err: <nil> Duration: 450.292695ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 586.527324ms FAIL (2025-08-19 17:53:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== ]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:20:30.724709450 (263h54m11.4559771s) [seg_pos={0 0}, upload=274457]: Begin upload segment... Aug 19 17:20:30.724753462 (263h54m11.456021113s) [seg_pos={0 0}, upload=274457]: Done begin upload segment. Aug 19 17:20:30.724781936 (263h54m11.456049586s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.724797054 (263h54m11.456064674s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725166569 (263h54m11.456434189s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725324816 (263h54m11.456592476s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725415496 (263h54m11.456683126s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725643935 (263h54m11.456911565s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725817342 (263h54m11.457084992s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725853730 (263h54m11.45712136s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725891440 (263h54m11.457159071s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726110873 (263h54m11.457378504s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726322932 (263h54m11.457590582s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726338811 (263h54m11.457606432s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726711522 (263h54m11.457979172s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727114529 (263h54m11.458382178s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727561679 (263h54m11.458829329s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728022655 (263h54m11.459290316s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728544566 (263h54m11.459812225s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728932415 (263h54m11.460200435s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.813701018 (263h54m11.544968628s) [upload=274457]: Next returned nil segment Aug 19 17:20:30.813711287 (263h54m11.544978897s) [upload=274457]: Waiting for error group managing segments... Aug 19 17:20:30.826872026 (263h54m11.558139646s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.832633702 (263h54m11.563901332s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.834038051 (263h54m11.565305681s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.844605367 (263h54m11.575872987s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.864222729 (263h54m11.59549035s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.866711214 (263h54m11.597978835s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.882824352 (263h54m11.614091972s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:31.250301081 (263h54m11.981568741s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:11.439696042 (263h54m52.170963692s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:13.585367789 (263h54m54.316635419s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:16.506635739 (263h54m57.237903369s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:22.880177884 (263h55m3.611445533s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:30.678773057 (263h55m11.410040716s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:14fc8QANkMVxxrHcXTWi1yyDhE2gz8BJNwRuvJNfX56TyQCWYZ, address:45.91.116.7:4032): protocol: rpc: dial tcp 45.91.116.7:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678847767 (263h55m11.410115416s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1yd47We7k2qgmcAVz5DhwZQMfnX71BrmLmtBoYyLn7D8t1psh2, address:45.91.116.12:4238): protocol: read tcp 5.161.89.252:32834->45.91.116.12:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678926845 (263h55m11.410194495s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd, address:77.90.31.21:4890): protocol: rpc: dial tcp 77.90.31.21:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678951581 (263h55m11.410219241s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo, address:77.90.31.18:4829): protocol: rpc: dial tcp 77.90.31.18:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678966439 (263h55m11.410234099s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: write tcp 5.161.89.252:42466->77.90.31.14:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679024038 (263h55m11.410291688s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7, address:45.91.116.10:4107): protocol: read tcp 5.161.89.252:39718->45.91.116.10:4107: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679071326 (263h55m11.410338977s) [seg_pos={0 0}, upload=274457]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 19 17:21:30.694027780 (263h55m11.425295431s) [upload=274457]: Done uploading segments... Aug 19 17:21:30.694046335 (263h55m11.425313986s) [upload=274457]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration:* 586.549106ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X...X.................................] duration: 414.238322ms FAIL (2025-08-19 17:52:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 414.261525ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....................X.X.X.............XX....................] duration: 426.804585ms FAIL (2025-08-19 17:52:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:35:24.598550906 (264h9m5.329818526s) [upload=274709]: Starting upload Aug 19 17:35:24.598598336 (264h9m5.329865966s) [upload=274709]: Done starting upload Aug 19 17:35:24.598705527 (264h9m5.329973177s) [upload=274709]: Uploading segments... Aug 19 17:35:24.598834049 (264h9m5.330101679s) [upload=274709]: Got next segment. Inline: false Aug 19 17:35:24.598891597 (264h9m5.330159247s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:35:24.598922305 (264h9m5.330189965s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:35:24.622781310 (264h9m5.354048961s) [seg_pos={0 0}, upload=274709]: Begin upload segment... Aug 19 17:35:24.622850871 (264h9m5.35411852s) [seg_pos={0 0}, upload=274709]: Done begin upload segment. Aug 19 17:35:24.622881097 (264h9m5.354148758s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.622915473 (264h9m5.354183093s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623242778 (264h9m5.354510398s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623434598 (264h9m5.354702257s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623465406 (264h9m5.354733026s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623704975 (264h9m5.354972595s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.623972749 (264h9m5.355240369s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624046368 (264h9m5.355314018s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624428025 (264h9m5.355695684s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.624838907 (264h9m5.356106557s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625410892 (264h9m5.356678542s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.625821152 (264h9m5.357088803s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626247935 (264h9m5.357515585s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.626718509 (264h9m5.35798616s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627108321 (264h9m5.358375972s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627468548 (264h9m5.358736198s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.627964190 (264h9m5.35923184s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.628364072 (264h9m5.359631721s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Uploading piece... Aug 19 17:35:24.722088727 (264h9m5.453356348s) [upload=274709]: Next returned nil segment Aug 19 17:35:24.722132710 (264h9m5.45340033s) [upload=274709]: Waiting for error group managing segments... Aug 19 17:35:24.742673821 (264h9m5.473941441s) [noise=true , address=104.36.82.60:4349 , piece_id=HFWGB436WWH535HPNQ7SLRJRQM7RJDQW4CEERUULHQCQ2ROQGWHA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.743213144 (264h9m5.474480765s) [noise=true , address=104.36.82.23:4476 , piece_id=SRG6T76SWPBTJ6AEHCA2QE44DGAKKDZGQQTQBQJAAMH5FNBJOOPQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.744830845 (264h9m5.476098485s) [noise=true , address=104.36.82.11:4123 , piece_id=UXFAZM72ULZJDE4WRGWOFIES6OIFNME5KRIPHH3HZ62GJDGBAJGA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.747023905 (264h9m5.478291526s) [noise=true , address=77.90.31.11:4566 , piece_id=4GVA4CW4YJGMSIDBG3RUGHJISQMBQVJG26ELKJLOJHJ5QWH42PZA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.753657211 (264h9m5.484924862s) [noise=true , address=104.36.82.15:4270 , piece_id=CRUIMZHVLJ4TSPJDQBNBF2DNLTAAINMYKWN7ANGLCUKCPXHRW54Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.754442816 (264h9m5.485710437s) [noise=true , address=104.36.82.12:4156 , piece_id=OM75LKW4ZTU7BLIN4IGLWGZMBA4KFUZ275LEPM3DVAZHHE2UGUKA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.756549285 (264h9m5.487816925s) [noise=true , address=45.91.116.12:4246 , piece_id=GCV2OSOQ2WOTMRXDC47HEFBEGFYEWRA5TV6BRBNR2JK6N3N6R7AQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.757132692 (264h9m5.488400312s) [noise=true , address=104.36.82.35:4607 , piece_id=CWGDXRAAOPBVZK3HM4MFZTC3DT2KBS7GCGK7QCZOQL6PL2S3IHDA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.758813881 (264h9m5.490081521s) [noise=true , address=77.90.31.13:4655 , piece_id=24S543QUBH4DQF3N2QDHHUSBOODABXVFD6LNVQJJHFDOZSHQFESQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.760553070 (264h9m5.491820689s) [noise=true , address=104.36.82.39:4728 , piece_id=H2EHJSSJLZUFRCDZORJCVRU2RENBGNYS4VLLNFP3CVLFPHWQSL2Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.761195576 (264h9m5.492463197s) [noise=true , address=45.91.116.13:4171 , piece_id=ZE654ZPDWEIAU3GG4DIC7GWF6QOKBKSTYB7MYCVJGQZFGNIC7OPA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.762297076 (264h9m5.493564726s) [noise=true , address=45.91.116.11:4131 , piece_id=QNET7XJBYHVXRBBP4YPIDMPGH3KNS3UM27D7YCC5QEYAG6XETWYQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.778979887 (264h9m5.510247517s) [noise=true , address=77.90.31.17:4796 , piece_id=77XR47AJGR5GUGFNQ3F7LVARB36B3MLPPJEVXH5IHS7KBGKTIH7Q, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785621458 (264h9m5.516889107s) [noise=true , address=104.36.82.19:4427 , piece_id=R4SVH2DTKSTPPREK3ZKI2CCLP4JLJQZLIHTIA5MJ4Q6VSGN56APA, seg_pos={0 0}, upload=274709]: Done uploading piece. err: <nil> Aug 19 17:35:24.785659460 (264h9m5.5169271s) [seg_pos={0 0}, upload=274709]: Segment reached optimal threshold of 14 pieces. Aug 19 17:35:24.785819780 (264h9m5.51708741s) [noise=true , address=77.90.31.15:4725 , piece_id=PLEAIIR264NPCGAX3FGZICI4WG7HJQ5LBMHOHDJ4WIWDCNFOLZSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nstPr2GMJo6pnBmBuDME5QYw3mXgnqLoaTKkcKUhjSbAY8mQk): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.785925820 (264h9m5.51719347s) [noise=true , address=45.91.116.6:4005 , piece_id=WSW5RKYHGG56AMLIGSFYDS364NLBJMSV4XKKMKOSV6IGLQQCJ4NQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W5pHzd3BFgkMPrMhSwTQBSxbSp7khERtcaCbZn1crJobN5zWn): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786017702 (264h9m5.517285332s) [noise=true , address=77.90.31.18:4808 , piece_id=FGDO53D4FLPXTKC2VAZWK5QRM4L53CQWTNCFXTXO4MFSNAZ5NOSQ, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9): protocol: expected piece hash; context canceled; EOF Aug 19 17:35:24.786091801 (264h9m5.517359452s) [noise=true , address=66.23.193.175:4559 , piece_id=C7LOCAYKD74IZCF7ZXPPHPQTLKO4J5BJQY7S3ICYFJRM6GLKJO2A, seg_pos={0 0}, upload=274709]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: read tcp 5.161.89.252:57194->66.23.193.175:4559: use of closed network connection; context canceled Aug 19 17:35:24.786125735 (264h9m5.517393385s) [seg_pos={0 0}, upload=274709]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 17:35:24.786208471 (264h9m5.517476122s) [upload=274709]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 17:35:24.786213561 (264h9m5.517481211s) [upload=274709]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:35:24.829790861 (264h9m5.56105848s) [upload=274709]: Done uploading segments... Aug 19 17:35:24.829804556 (264h9m5.561072186s) [upload=274709]: Upload finished. err: <nil> Duration: 426.826835ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X...........X.....................X........................] duration: 270.333246ms FAIL (2025-08-19 17:52:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 270.354406ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 710.464832ms FAIL (2025-08-19 17:52:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== ]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 17:20:30.724709450 (263h54m11.4559771s) [seg_pos={0 0}, upload=274457]: Begin upload segment... Aug 19 17:20:30.724753462 (263h54m11.456021113s) [seg_pos={0 0}, upload=274457]: Done begin upload segment. Aug 19 17:20:30.724781936 (263h54m11.456049586s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.724797054 (263h54m11.456064674s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725166569 (263h54m11.456434189s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725324816 (263h54m11.456592476s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725415496 (263h54m11.456683126s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725643935 (263h54m11.456911565s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725817342 (263h54m11.457084992s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725853730 (263h54m11.45712136s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.725891440 (263h54m11.457159071s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726110873 (263h54m11.457378504s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726322932 (263h54m11.457590582s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726338811 (263h54m11.457606432s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.726711522 (263h54m11.457979172s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727114529 (263h54m11.458382178s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.727561679 (263h54m11.458829329s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728022655 (263h54m11.459290316s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728544566 (263h54m11.459812225s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.728932415 (263h54m11.460200435s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Uploading piece... Aug 19 17:20:30.813701018 (263h54m11.544968628s) [upload=274457]: Next returned nil segment Aug 19 17:20:30.813711287 (263h54m11.544978897s) [upload=274457]: Waiting for error group managing segments... Aug 19 17:20:30.826872026 (263h54m11.558139646s) [noise=true , address=104.36.82.23:4458 , piece_id=B6SB2PNKJIT5GLPS7Z2ZFPT7A2PXDFHHC3QHCH2MQ3I4WK7MPRSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.832633702 (263h54m11.563901332s) [noise=true , address=104.36.82.44:4882 , piece_id=FADDUTQAO3INVE2JAWVR4SQISS7DZPV7ROI2FHIDZED6VQCLPKKA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.834038051 (263h54m11.565305681s) [noise=true , address=79.127.219.47:4062 , piece_id=A6756Y5PYSEIPMBUN6SAQ7DXQNADFJS6ECMYKBKSH2MPK6MYUT6A, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.844605367 (263h54m11.575872987s) [noise=true , address=104.36.82.2:4764 , piece_id=CBWOVFNOYNAY5F462E5J4KNX5LLYKZQEEJUOLKXLPDCWWHOMWW2Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.864222729 (263h54m11.59549035s) [noise=true , address=104.36.82.17:4353 , piece_id=X4HQY47TKKQ72QPDBMYFK3JHFKPQVTF5BFSXWYNYGAELKBV75KOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.866711214 (263h54m11.597978835s) [noise=true , address=104.36.82.34:4559 , piece_id=J5RYVJTRFQG6REZAZJW7URTZQHMQON2SUP5QHDIK53VHV3KJCLSA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:30.882824352 (263h54m11.614091972s) [noise=true , address=104.36.82.43:4839 , piece_id=SNPCZ3JHY3V2TNJI2INTRZSBDVXVTFQHKOITBEVAAZ5PFOHPSZSQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:20:31.250301081 (263h54m11.981568741s) [noise=true , address=79.127.205.235:4692 , piece_id=OJJ2PG7H3IBPMW5PFWO4YLQ3KT2D5YFH2PSWCOX3CGUZRFFZWB4Q, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:11.439696042 (263h54m52.170963692s) [noise=true , address=77.90.31.17:4797 , piece_id=AVUG5MVC6F7JVM2AWXCWFG5WZ7XGYT24H5QY36W7DCQQAMSHUTLA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:13.585367789 (263h54m54.316635419s) [noise=true , address=45.91.116.11:4147 , piece_id=23JASHPHO3VFWMEKGIT63COZGTWK3I3EEEKGRS7GX7SIFKIURILQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:16.506635739 (263h54m57.237903369s) [noise=true , address=77.90.31.16:4763 , piece_id=2V5IWUJHLF3YH3ZBQJFNH2JCGZ54SQASHQ5FLLGHEQOOSISFKWJQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:22.880177884 (263h55m3.611445533s) [noise=true , address=77.90.31.17:4783 , piece_id=RYTX2QLEKTYQTOR3NSZIPY2TWTBL2ZUKSJV5ORBKH5R2ZPXUKBNQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: <nil> Aug 19 17:21:30.678773057 (263h55m11.410040716s) [noise=true , address=45.91.116.7:4032 , piece_id=M2BXIGAGRRSUZ7EGWFA2IAFQV7ZRUZCH5NBWS4PYFACOGWN6COZQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:14fc8QANkMVxxrHcXTWi1yyDhE2gz8BJNwRuvJNfX56TyQCWYZ, address:45.91.116.7:4032): protocol: rpc: dial tcp 45.91.116.7:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678847767 (263h55m11.410115416s) [noise=true , address=45.91.116.12:4238 , piece_id=6NKCMPVSRFRDDX3TU3ET2KOLQ2DCU2OVNZI5U6ZLUWP6JTF3PCWQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1yd47We7k2qgmcAVz5DhwZQMfnX71BrmLmtBoYyLn7D8t1psh2, address:45.91.116.12:4238): protocol: read tcp 5.161.89.252:32834->45.91.116.12:4238: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678926845 (263h55m11.410194495s) [noise=true , address=77.90.31.21:4890 , piece_id=5CIXXVAF25OX7BV7JI6QQ3UZ6JE62XC2GBZOYUMOQQXT3HUD5JOQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd, address:77.90.31.21:4890): protocol: rpc: dial tcp 77.90.31.21:4890: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678951581 (263h55m11.410219241s) [noise=true , address=77.90.31.18:4829 , piece_id=Y43CQMZRAZPDXAXNJJHFDX3C3LEKTFBBLKNRGMVWM7WUM34TVLHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1548pzNGffaMonic7dMK5VtZhLHtae3iffd9wjfjyTCp4XJ7Lo, address:77.90.31.18:4829): protocol: rpc: dial tcp 77.90.31.18:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.678966439 (263h55m11.410234099s) [noise=true , address=77.90.31.14:4695 , piece_id=I3HQFGDDWHDKIGJELHQXZ6MZQYCZ5TUDG4RK4M2OLJBNAS7TNWHQ, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:12q2kob5oYxuxwUDh4vjNDBpW4c6LndrjHbsJ4VRDiBsLxjgLdy, address:77.90.31.14:4695): protocol: write tcp 5.161.89.252:42466->77.90.31.14:4695: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679024038 (263h55m11.410291688s) [noise=true , address=45.91.116.10:4107 , piece_id=5Q5KSIA3G2LXQGXCAJRW2S7SKLOIQQYZ4EHMB3WZEB7UHA3F25WA, seg_pos={0 0}, upload=274457]: Done uploading piece. err: ecclient: upload failed (node:1U16aJ2LZPaRGyRizyyCbMJjUgtuDcaHaMsrQFbXHuyVGRc1w7, address:45.91.116.10:4107): protocol: read tcp 5.161.89.252:39718->45.91.116.10:4107: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:21:30.679071326 (263h55m11.410338977s) [seg_pos={0 0}, upload=274457]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Aug 19 17:21:30.694027780 (263h55m11.425295431s) [upload=274457]: Done uploading segments... Aug 19 17:21:30.694046335 (263h55m11.425313986s) [upload=274457]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration:* 710.498856ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X...........X.....................X.......................] duration: 357.663765ms FAIL (2025-08-19 17:52:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 357.686347ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.350242693s FAIL (2025-08-19 17:52:10 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 1.350266668s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X....X....................................] duration: 391.411439ms FAIL (2025-08-19 17:51:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== [seg_pos={0 0}, upload=274520]: Done begin upload segment. Aug 19 17:24:12.024531859 (263h57m52.755799509s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024547178 (263h57m52.755814828s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024953521 (263h57m52.756221171s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.024997523 (263h57m52.756265174s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025367439 (263h57m52.756635089s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025414347 (263h57m52.756681997s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025761920 (263h57m52.75702958s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.025888298 (263h57m52.757155948s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026138559 (263h57m52.757406208s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026283681 (263h57m52.75755133s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026491962 (263h57m52.757759613s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026640120 (263h57m52.757907771s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026842701 (263h57m52.758110352s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.026995178 (263h57m52.758262828s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027210582 (263h57m52.758478232s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.027858310 (263h57m52.75912596s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Uploading piece... Aug 19 17:24:12.143746757 (263h57m52.875014407s) [upload=274520]: Next returned nil segment Aug 19 17:24:12.143775502 (263h57m52.875043152s) [upload=274520]: Waiting for error group managing segments... Aug 19 17:24:12.157847553 (263h57m52.889115213s) [noise=true , address=104.36.82.13:4185 , piece_id=G6V7LQWJ3UC4PMMPBZWE67KWQXQENEEO4O4763VEGVGEVIDJ5FEA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158547338 (263h57m52.889814989s) [noise=true , address=104.36.82.5:4837 , piece_id=AM2AXREOT4ZII77PAWUE76BM6AR4YGI3XF5CGUWRKEE5R5FTDIFA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.158808157 (263h57m52.890075818s) [noise=true , address=104.36.82.2:4729 , piece_id=LY2SWRDWXQHES5FTAF5CP6KCNVCY6FHIBKJNLOCEFYSBNBPIPNIA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.159159038 (263h57m52.890426688s) [noise=true , address=104.36.82.7:4912 , piece_id=ADZS3KGOOF4HPEYRXYTTS7WHDRKRBGRIKUKCORRSAENYPHXMEGHA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.160381044 (263h57m52.891648694s) [noise=true , address=104.36.82.7:4909 , piece_id=QB6Z7VE6VFC5L3BNINLJTO53YACDUGNBL6U7WUHKSG5HAFVSXAJQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:12.163470309 (263h57m52.894737959s) [noise=true , address=104.36.82.9:4007 , piece_id=YEAQAGKXBODCVNIAG2S7TT5MP3TKTC5PAWGA7CIIBEW5DYS7UQCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: <nil> Aug 19 17:24:41.979520414 (263h58m22.710788064s) [noise=true , address=77.90.31.13:4628 , piece_id=B2BESUZXB37NOFSOEUPCUXX3AMEZ44S62HIKN7K4P2FD65CPEDPQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: read tcp 5.161.89.252:36766->77.90.31.13:4628: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980102297 (263h58m22.711369958s) [noise=true , address=45.91.116.14:4190 , piece_id=3AZCPPFTZFZ7ANINXPAIR433CKJUXEVDB7FYJIQDLHMYIMRFTGKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 5.161.89.252:21646->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980158464 (263h58m22.711426114s) [noise=true , address=45.91.116.4:4939 , piece_id=BTZOJWID4G2ADAZKPQ6PW7SMV42R2FM756KFMCBSBAMFMJDFULWQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 5.161.89.252:51578->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980204240 (263h58m22.71147189s) [noise=true , address=77.90.31.11:4554 , piece_id=OQYJJPQRLA64VFXA5VBWDKJ73Q2YMLTRW3UXJVNBQ3BLCZ55TZ5Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: read tcp 5.161.89.252:9778->77.90.31.11:4554: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980249345 (263h58m22.711517004s) [noise=true , address=77.90.31.14:4661 , piece_id=WDR237S6GBHWJGAO2L7M5YASTXX6QOLMIMDZM2D57PQHZA7BYB2Q, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: read tcp 5.161.89.252:22472->77.90.31.14:4661: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980292254 (263h58m22.711559905s) [noise=true , address=45.91.116.14:4189 , piece_id=QVER7IKF6T66GHOKDYVUVAYBF4OWORQV3IPKXKTREBYXOLKUI6HA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: read tcp 5.161.89.252:34124->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980365091 (263h58m22.711632752s) [noise=true , address=45.91.116.8:4045 , piece_id=X2HZK7QLI7RRZMF6WYSHK4TYUCPWMF7XRY6KVWKG7SOMGZK4HZXA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: write tcp 5.161.89.252:8238->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980403213 (263h58m22.711670863s) [noise=true , address=77.90.31.19:4841 , piece_id=MY2CTXR6M4Z7JDC5BE3HENPMUOXXSVX22PNG236QOH5F3552PFCQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980547475 (263h58m22.711815124s) [noise=true , address=45.91.116.6:4973 , piece_id=MP533ZUEZDRXYTQPWKM5URFX6BB3WPGAPFHFMUJQVNBZFPTJHICA, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 5.161.89.252:29404->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980632083 (263h58m22.711899743s) [noise=true , address=77.90.31.12:4592 , piece_id=LYEZMNLTZVT4UQHZL53CGXZXPHLPJPO34EMLPPRARNVULCOQPXKQ, seg_pos={0 0}, upload=274520]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 17:24:41.980736129 (263h58m22.712003779s) [seg_pos={0 0}, upload=274520]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Aug 19 17:24:41.997898729 (263h58m22.729166379s) [upload=274520]: Done uploading segments... Aug 19 17:24:41.997919457 (263h58m22.729187108s) [upload=274520]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 391.447595ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X...........X.....................X......................] duration: 159.052431ms FAIL (2025-08-19 17:51:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Aug 19 17:34:41.705413405 (264h8m22.436681035s) [upload=274699]: Starting upload Aug 19 17:34:41.705456125 (264h8m22.436723755s) [upload=274699]: Done starting upload Aug 19 17:34:41.705499847 (264h8m22.436767467s) [upload=274699]: Uploading segments... Aug 19 17:34:41.705540113 (264h8m22.436807743s) [upload=274699]: Got next segment. Inline: true Aug 19 17:34:41.705546515 (264h8m22.436814165s) [upload=274699]: Waiting for error group managing segments... Aug 19 17:34:41.705593683 (264h8m22.436861313s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 17:34:41.705597821 (264h8m22.436865451s) [upload=274699]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 17:34:41.705600336 (264h8m22.436867955s) [upload=274699]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 17:34:41.781184293 (264h8m22.512451923s) [upload=274699]: Done uploading segments... Aug 19 17:34:41.781200663 (264h8m22.512468293s) [upload=274699]: Upload finished. err: <nil> Duration:* 159.102215ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)