Orbiter History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 178.006004ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-19 04:28:50 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 178.029609ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 698.927662ms target: https://ap1.storj.io/login FAIL (2025-08-19 04:28:50 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout Duration: 698.940887ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................................................XXXX.] duration: 532.538219ms FAIL (2025-08-19 04:28:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 2) ======LOGS====== Aug 19 04:27:49.109078986 (251h1m29.840346686s) [upload=261106]: Starting upload Aug 19 04:27:49.109176229 (251h1m29.84044389s) [upload=261106]: Done starting upload Aug 19 04:27:49.109275225 (251h1m29.840542885s) [upload=261106]: Uploading segments... Aug 19 04:27:49.109595368 (251h1m29.840863017s) [upload=261106]: Got next segment. Inline: false Aug 19 04:27:49.109658597 (251h1m29.840926246s) [upload=261106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:27:49.109666732 (251h1m29.840934381s) [upload=261106]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:27:49.134178766 (251h1m29.865446416s) [seg_pos={0 0}, upload=261106]: Begin upload segment... Aug 19 04:27:49.134254959 (251h1m29.865522609s) [seg_pos={0 0}, upload=261106]: Done begin upload segment. Aug 19 04:27:49.134289924 (251h1m29.865557575s) [noise=true , address=104.36.82.44:4880 , piece_id=OWN24XFAQIM7CMFWBVRK6PV4ERW3TBTNA7VIB2TYN27G3TBOPBRQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.134334910 (251h1m29.86560256s) [noise=true , address=79.127.201.215:4356 , piece_id=TILCDB2RMDIH7BJ4FW6WQQA2LM5BOWLAGNTLYAYIMKDYM2CMR67A, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.134795515 (251h1m29.866063155s) [noise=true , address=77.90.31.15:4718 , piece_id=SYYDCERFUSC7JVNEUCUSWTPHOCKPYH5HFEO6KQSVG3FI6JDLXLWQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135276820 (251h1m29.866544471s) [noise=true , address=45.91.116.14:4194 , piece_id=HZXGZJPTHDOYJAQWT4RVKJ752SKAYQS4O5RR5BEKLMQ4SIQJ2SHA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135483198 (251h1m29.866750918s) [noise=true , address=45.91.116.5:4331 , piece_id=DPOTJF7RFLT44ADTZPVH7VR3YUCPYAXEOUZDKERJV22SPSGROM7A, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135835029 (251h1m29.86710268s) [noise=true , address=66.23.193.175:4557 , piece_id=ZSROC6HZO7LIP4SI7SPJCBTRUGPSHB62EISHETVUTQMRJTQBSMTA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135982557 (251h1m29.867250207s) [noise=true , address=45.91.116.8:4068 , piece_id=AKGKSIWCFRFYZGFB22H2Q3FAG6XNNR7LBCMV3KULU4CFGAAQ2YYA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136339348 (251h1m29.867606998s) [noise=true , address=104.36.82.60:4364 , piece_id=LV2P23XGSL6F6KFF7HDI4Z5BCB7WYEFNVYOTHG4Q7A2ERIVCIOAQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136504377 (251h1m29.867772038s) [noise=true , address=45.91.116.13:4157 , piece_id=VVL7322GYRIASBHU36CMMX5G4VWLEG4O2L53RCSK7AG3Z6MZ45VA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136732658 (251h1m29.868000308s) [noise=true , address=45.91.116.7:4021 , piece_id=KDCRCAW6746D4XEY25R33PMTLB5XCNZHD26QXMRQ6D6CO67BMLWQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137048441 (251h1m29.868316111s) [noise=true , address=45.91.116.11:4131 , piece_id=W7QKRAXI7TA3PIU4ECH7GCPRTKGDZAMTRYYL6UJJ5GA7FGTA4JEA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137154821 (251h1m29.86842246s) [noise=true , address=45.91.116.9:4292 , piece_id=ADAI7NEMMI7ZNIB47HHPUGSZ6ZXDZ3Y62HX6IWODYSBJV6RPK5HQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137545365 (251h1m29.868813055s) [noise=true , address=77.90.31.17:4791 , piece_id=CR364E44HFK3FWRAN66ZTZBJACZRE4XQF55FYNEHDET3M2YIMQEA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137595189 (251h1m29.86886284s) [noise=true , address=77.90.31.18:4834 , piece_id=PBGC5NB37NOL3R5DXORQNDCOJTAXWGDMTVCZA6UGET3IBLK6C27Q, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.138058961 (251h1m29.869326611s) [noise=true , address=77.90.31.19:4848 , piece_id=F3KSQJIANH5VCAYYYUQVTTA4CMZGRRHKCQNURLQN3AYHKVDOGGXA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.138607101 (251h1m29.869874751s) [noise=true , address=104.36.82.2:4744 , piece_id=RRUKZCLUW2RZEYTZNCRUIACUQK5UQ5HSDYTC43VDE4KV6HZMTFTQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.139135725 (251h1m29.870403376s) [noise=true , address=104.36.82.5:4851 , piece_id=P5QD3QUIGQHWZL7ZADHRHTJ4R7MFQG3W5MAWSXTL4VWBJVY7AWQQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.145535768 (251h1m29.876803418s) [noise=true , address=104.36.82.8:4994 , piece_id=XE5CSSEZHBRSS42BSBUVZAMFTZQP5BOSNCILEPXCIZPEDFTQLPUA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.330351465 (251h1m30.061619115s) [upload=261106]: Next returned nil segment Aug 19 04:27:49.330371102 (251h1m30.061638752s) [upload=261106]: Waiting for error group managing segments... Aug 19 04:27:49.396836051 (251h1m30.128103681s) [noise=true , address=79.127.201.215:4356 , piece_id=TILCDB2RMDIH7BJ4FW6WQQA2LM5BOWLAGNTLYAYIMKDYM2CMR67A, seg_pos={0 0}, upload=261106]: Done uploading piece. err: <nil> Aug 19 04:27:49.722370750 (251h1m30.4536384s) [noise=true , address=66.23.193.175:4557 , piece_id=ZSROC6HZO7LIP4SI7SPJCBTRUGPSHB62EISHETVUTQMRJTQBSMTA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: <nil> Aug 19 04:28:49.088391363 (251h2m29.819658993s) [noise=true , address=45.91.116.13:4157 , piece_id=VVL7322GYRIASBHU36CMMX5G4VWLEG4O2L53RCSK7AG3Z6MZ45VA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj, address:45.91.116.13:4157): protocol: rpc: dial tcp 45.91.116.13:4157: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088478717 (251h2m29.819746348s) [noise=true , address=104.36.82.8:4994 , piece_id=XE5CSSEZHBRSS42BSBUVZAMFTZQP5BOSNCILEPXCIZPEDFTQLPUA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:13nneaPpsRT7mVEc6cDt7GiZSMTU68Nnk1rr9Lbn5ycZkmQGrB, address:104.36.82.8:4994): protocol: rpc: dial tcp 104.36.82.8:4994: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088549861 (251h2m29.819817491s) [noise=true , address=104.36.82.5:4851 , piece_id=P5QD3QUIGQHWZL7ZADHRHTJ4R7MFQG3W5MAWSXTL4VWBJVY7AWQQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R, address:104.36.82.5:4851): protocol: rpc: dial tcp 104.36.82.5:4851: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088642636 (251h2m29.819910266s) [noise=true , address=104.36.82.44:4880 , piece_id=OWN24XFAQIM7CMFWBVRK6PV4ERW3TBTNA7VIB2TYN27G3TBOPBRQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:104.36.82.44:4880): protocol: rpc: dial tcp 104.36.82.44:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088691026 (251h2m29.819958646s) [noise=true , address=77.90.31.15:4718 , piece_id=SYYDCERFUSC7JVNEUCUSWTPHOCKPYH5HFEO6KQSVG3FI6JDLXLWQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC, address:77.90.31.15:4718): protocol: write tcp 5.161.89.252:52356->77.90.31.15:4718: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088749125 (251h2m29.820016755s) [noise=true , address=45.91.116.8:4068 , piece_id=AKGKSIWCFRFYZGFB22H2Q3FAG6XNNR7LBCMV3KULU4CFGAAQ2YYA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1jN6HbQbPBjk645swQd33LrTfb3LbAWk1dPNXU45zFrgmm6Q82, address:45.91.116.8:4068): protocol: rpc: dial tcp 45.91.116.8:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088802316 (251h2m29.820069946s) [noise=true , address=104.36.82.60:4364 , piece_id=LV2P23XGSL6F6KFF7HDI4Z5BCB7WYEFNVYOTHG4Q7A2ERIVCIOAQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk, address:104.36.82.60:4364): protocol: rpc: dial tcp 104.36.82.60:4364: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088852240 (251h2m29.82011987s) [noise=true , address=77.90.31.17:4791 , piece_id=CR364E44HFK3FWRAN66ZTZBJACZRE4XQF55FYNEHDET3M2YIMQEA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM, address:77.90.31.17:4791): protocol: write tcp 5.161.89.252:21530->77.90.31.17:4791: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089043649 (251h2m29.82031127s) [noise=true , address=45.91.116.9:4292 , piece_id=ADAI7NEMMI7ZNIB47HHPUGSZ6ZXDZ3Y62HX6IWODYSBJV6RPK5HQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12tnWSKAebAwLeGWGRsNnYpcWgbX5UHSVRUnnu9qesUZCK4vY81, address:45.91.116.9:4292): protocol: rpc: dial tcp 45.91.116.9:4292: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089121746 (251h2m29.820389376s) [noise=true , address=77.90.31.18:4834 , piece_id=PBGC5NB37NOL3R5DXORQNDCOJTAXWGDMTVCZA6UGET3IBLK6C27Q, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q, address:77.90.31.18:4834): protocol: rpc: dial tcp 77.90.31.18:4834: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089195093 (251h2m29.820462723s) [noise=true , address=77.90.31.19:4848 , piece_id=F3KSQJIANH5VCAYYYUQVTTA4CMZGRRHKCQNURLQN3AYHKVDOGGXA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD, address:77.90.31.19:4848): protocol: write tcp 5.161.89.252:19210->77.90.31.19:4848: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089270406 (251h2m29.820538036s) [noise=true , address=104.36.82.2:4744 , piece_id=RRUKZCLUW2RZEYTZNCRUIACUQK5UQ5HSDYTC43VDE4KV6HZMTFTQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12A6abQMwnX4PhLYTvkGLinPx4eNeVyS15SGzWiLUq4cwKQ6bmH, address:104.36.82.2:4744): protocol: rpc: dial tcp 104.36.82.2:4744: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089308247 (251h2m29.820575877s) [noise=true , address=45.91.116.5:4331 , piece_id=DPOTJF7RFLT44ADTZPVH7VR3YUCPYAXEOUZDKERJV22SPSGROM7A, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: rpc: dial tcp 45.91.116.5:4331: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089356988 (251h2m29.820624608s) [noise=true , address=45.91.116.7:4021 , piece_id=KDCRCAW6746D4XEY25R33PMTLB5XCNZHD26QXMRQ6D6CO67BMLWQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1bXLNG7g5RJc21AjrfHup6LDTd2dDJGWMzrBhVYwUT7fNm8J2Z, address:45.91.116.7:4021): protocol: rpc: dial tcp 45.91.116.7:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089381043 (251h2m29.820648673s) [noise=true , address=45.91.116.14:4194 , piece_id=HZXGZJPTHDOYJAQWT4RVKJ752SKAYQS4O5RR5BEKLMQ4SIQJ2SHA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:19mdk9cXDR79ZXC4n6rMXFUhpwxMPXFpkPA14ymY24RK1jKkmd, address:45.91.116.14:4194): protocol: rpc: dial tcp 45.91.116.14:4194: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089392665 (251h2m29.820660295s) [noise=true , address=45.91.116.11:4131 , piece_id=W7QKRAXI7TA3PIU4ECH7GCPRTKGDZAMTRYYL6UJJ5GA7FGTA4JEA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:124sCe84Td2UTjNKjgjFhaHbkkcLgvZY3Hn2LnAYYrsx5c14rUE, address:45.91.116.11:4131): protocol: write tcp 5.161.89.252:59470->45.91.116.11:4131: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089421198 (251h2m29.820688829s) [seg_pos={0 0}, upload=261106]: Done waiting for segment. successful: 2 optimal: 14 errs: <nil> Aug 19 04:28:49.140905793 (251h2m29.872173413s) [upload=261106]: Done uploading segments... Aug 19 04:28:49.140920150 (251h2m29.87218777s) [upload=261106]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 2) Duration: 532.556203ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 22.944498ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-19 04:28:43 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34965->127.0.0.1:53: i/o timeout Duration: 22.962651ms edge linksharing us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.471443599s FAIL (2025-08-19 04:28:38 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 1.471480127s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites) antiblip: 1 out of 15 is failed (threshold=6) [.........X.....] duration: 42.995874ms target: https://static.storj.io/dcs-satellites FAIL (2025-08-19 04:28:33 UTC) orbiter warning: Get "https://static.storj.io/dcs-satellites": dial tcp 34.120.119.150:443: i/o timeout Duration: 43.013368ms core website
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 182.400295ms FAIL (2025-08-19 04:28:30 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 182.424702ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 30.023311793s FAIL (2025-08-19 04:28:29 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== ad=261108]: Uploading piece... Aug 19 04:27:59.298715587 (251h1m40.029983236s) [noise=true , address=45.91.116.10:4081 , piece_id=VXW7T7RYDQYFA67EV4IP5EFMNLSPHO6YMYO4NCUBCDOSPQWID6KQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.298767684 (251h1m40.030035364s) [noise=true , address=45.91.116.11:4119 , piece_id=6NZDOUCLI5JRQ5XXZMNLBXIVXMHR7NJY6BTCMA22QMNC3ZJJFCMA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299257736 (251h1m40.030525387s) [noise=true , address=45.91.116.10:4083 , piece_id=N7ABFK4IGEFBUNEAQI3SFS7IC6SCOHQD4TN2QOWDUSNRM4ZLXV7A, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299339650 (251h1m40.030607301s) [noise=true , address=77.90.31.21:4878 , piece_id=X3FKRFUU6S3AB6ZPUNPB2HOGLJ5E7U4AWTEFH6PISRIBECP3GVSQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299714204 (251h1m40.030981855s) [noise=true , address=45.91.116.8:4045 , piece_id=OH3KNS4URAIN3T4FLAPSYC2SHQKOEBLJMF2AVG7MXJULLC3P7QYA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299820754 (251h1m40.031088415s) [noise=true , address=77.90.31.10:4517 , piece_id=QXH4JBJTSA4VLHPS2OUAR3XF7QEL3WSX2JJT7VTZMRBVWS3OIOQQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300136579 (251h1m40.031404229s) [noise=true , address=77.90.31.12:4592 , piece_id=25GKL2MHGGV6IC7JDU5MBJ4MOCCNPGMXQPYXH7A4FFFJ5EZGVZ2Q, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300491886 (251h1m40.031759547s) [noise=true , address=45.91.116.9:4261 , piece_id=RAEAWIKMHIV4VGOZY57ZK36BNZGZ2ATXTXC4YHRABT6VWB6MGILA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300854618 (251h1m40.032122269s) [noise=true , address=104.36.82.2:4732 , piece_id=WKRORDL2XPRF2KRKZ55EQ2PTPJHPJSQ6NQ4D3VVFK6COGG57KDNQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.301277543 (251h1m40.032545194s) [noise=true , address=45.91.116.14:4190 , piece_id=SGZNGKGYEKPU4GXCULPKYIOONZZXZT6UTO7MDWYOJRJJW4WSG3VA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.301655164 (251h1m40.032922814s) [noise=true , address=104.36.82.7:4910 , piece_id=R6GR56GOKT2K3AX75OL3BWODTZ4FJY27MIOQWFYJVY4UGR66DIBQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.302072699 (251h1m40.033340349s) [noise=true , address=104.36.82.16:4294 , piece_id=GT3KQOCWD2YTWBQDAO5QJKYIMZINUF4MESKP6F3P6J73R4IY3NDQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:28:02.354368898 (251h1m43.085636557s) [noise=true , address=77.90.31.21:4878 , piece_id=X3FKRFUU6S3AB6ZPUNPB2HOGLJ5E7U4AWTEFH6PISRIBECP3GVSQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 5.161.89.252:64042->77.90.31.21:4878: write: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:02.385567243 (251h1m43.116834893s) [noise=true , address=77.90.31.12:4592 , piece_id=25GKL2MHGGV6IC7JDU5MBJ4MOCCNPGMXQPYXH7A4FFFJ5EZGVZ2Q, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 5.161.89.252:34306->77.90.31.12:4592: write: no route to host; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Aug 19 04:28:29.225676153 (251h2m9.956943773s) [upload=261108]: Next segment err: context deadline exceeded Aug 19 04:28:29.225998790 (251h2m9.95726642s) [noise=true , address=104.36.82.2:4732 , piece_id=WKRORDL2XPRF2KRKZ55EQ2PTPJHPJSQ6NQ4D3VVFK6COGG57KDNQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: rpc: dial tcp 104.36.82.2:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226039707 (251h2m9.957307326s) [noise=true , address=45.91.116.11:4119 , piece_id=6NZDOUCLI5JRQ5XXZMNLBXIVXMHR7NJY6BTCMA22QMNC3ZJJFCMA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226072177 (251h2m9.957339798s) [noise=true , address=45.91.116.8:4045 , piece_id=OH3KNS4URAIN3T4FLAPSYC2SHQKOEBLJMF2AVG7MXJULLC3P7QYA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: rpc: dial tcp 45.91.116.8:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226223943 (251h2m9.957491573s) [noise=true , address=45.91.116.14:4190 , piece_id=SGZNGKGYEKPU4GXCULPKYIOONZZXZT6UTO7MDWYOJRJJW4WSG3VA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226274027 (251h2m9.957541647s) [noise=true , address=45.91.116.13:4154 , piece_id=WM56E23Z7FLRF33HYDXONXHODJDHPCJFWGVC3NI7RUTZUESWO4MQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: rpc: dial tcp 45.91.116.13:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226310786 (251h2m9.957578416s) [noise=true , address=77.90.31.17:4771 , piece_id=3BVZK3ZL7N5FC3OJGFFYTVEG7INVMLMG2QBPXX3UC3EJVXHBGW3Q, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: rpc: dial tcp 77.90.31.17:4771: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226348096 (251h2m9.957615726s) [noise=true , address=104.36.82.11:4114 , piece_id=P4RJRUZPRTFPRK5WWHKUVEKJKXGPPPCIV4RPFIZOBO2CPOXSTSIQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226392119 (251h2m9.957659749s) [noise=true , address=45.91.116.10:4081 , piece_id=VXW7T7RYDQYFA67EV4IP5EFMNLSPHO6YMYO4NCUBCDOSPQWID6KQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 5.161.89.252:44604->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226421564 (251h2m9.957689195s) [noise=true , address=45.91.116.9:4261 , piece_id=RAEAWIKMHIV4VGOZY57ZK36BNZGZ2ATXTXC4YHRABT6VWB6MGILA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: rpc: dial tcp 45.91.116.9:4261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226443746 (251h2m9.957711377s) [noise=true , address=45.91.116.4:4940 , piece_id=GYF7CH3463KOWU7DE7WKLYTXYXLTRMPOIK4K3D64ANKOERN33FGQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:53922->45.91.116.4:4940: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226474684 (251h2m9.957742315s) [noise=true , address=104.36.82.7:4910 , piece_id=R6GR56GOKT2K3AX75OL3BWODTZ4FJY27MIOQWFYJVY4UGR66DIBQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:104.36.82.7:4910): protocol: rpc: dial tcp 104.36.82.7:4910: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226493810 (251h2m9.95776143s) [noise=true , address=45.91.116.10:4083 , piece_id=N7ABFK4IGEFBUNEAQI3SFS7IC6SCOHQD4TN2QOWDUSNRM4ZLXV7A, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: rpc: dial tcp 45.91.116.10:4083: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226509199 (251h2m9.957776829s) [noise=true , address=104.36.82.16:4294 , piece_id=GT3KQOCWD2YTWBQDAO5QJKYIMZINUF4MESKP6F3P6J73R4IY3NDQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:104.36.82.16:4294): protocol: write tcp 5.161.89.252:25886->104.36.82.16:4294: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226527894 (251h2m9.957795524s) [noise=true , address=77.90.31.10:4517 , piece_id=QXH4JBJTSA4VLHPS2OUAR3XF7QEL3WSX2JJT7VTZMRBVWS3OIOQQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226544845 (251h2m9.957812476s) [seg_pos={0 0}, upload=261108]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.023323875s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 909.663178ms FAIL (2025-08-19 04:28:25 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 909.705289ms edge authservice http bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 201.314154ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-08-19 04:28:21 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 201.331528ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 4.939512627s FAIL (2025-08-19 04:28:19 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.939537053s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.020957792s FAIL (2025-08-19 04:28:13 UTC) operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== =true , address=104.36.82.44:4869 , piece_id=E4MMA6JCRBJCMN4OEGDCUODXJDEDF5YPXMREPHNASMXKVGRBZK6Q, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.459704671 (251h0m54.19097232s) [noise=true , address=77.90.31.17:4783 , piece_id=T4LBFWMNNHMRK5JYMO77QPQXPLXJYEZB3FAWLSEHJJJ5M2OEIKZA, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.461243503 (251h0m54.192511213s) [noise=true , address=45.91.116.11:4138 , piece_id=J4XXTBBI3XK7PRAQKDZBXICV4FDKCUZMUJS2VDQLWP35BWHC2VLA, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.462141351 (251h0m54.193409002s) [noise=true , address=104.36.82.23:4450 , piece_id=YWNLBVWNS2EYJWRB5TKG6JH4APUPX2652JZHXN5AFLQGPREOPCCQ, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.462990137 (251h0m54.194257787s) [noise=true , address=77.90.31.16:4768 , piece_id=G6MRDCVXYYZSJ6ZW5LREMO7V7LIGG4X4SJTCJD6PENW7M5JQXOKA, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.465969118 (251h0m54.197236768s) [noise=true , address=104.36.82.60:4362 , piece_id=TW6K6SDKOUX22BGG6A62TJBDICICVLL7OBBXYGRWW3EDGAB5WB3Q, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.467336419 (251h0m54.198604059s) [noise=true , address=79.127.220.101:4060 , piece_id=D43XCO3SJ3FCN35UH527HT4OADLQ3YLIHBSTX5VA7QCNURJCKXYQ, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.468897183 (251h0m54.200164823s) [noise=true , address=104.36.82.13:4211 , piece_id=WQ2ZWJE2TTUCEBN2X7REPVB3GCB2TMZEMBFNBRKGRON5FDPVUWMA, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.470701645 (251h0m54.201969285s) [noise=true , address=66.23.193.175:4562 , piece_id=42OPOWAZZJPMZ6YZKAWNRY7AUZQYMU5T6MWRXXQB6YOBY2UA4C7A, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.471456915 (251h0m54.202724556s) [noise=true , address=45.91.116.4:4971 , piece_id=WXVSH5RSOWSZ23NNPF543QZ4P3TWUI7AHGGQZTWBVT4PGIDJWYMA, seg_pos={0 0}, upload=261095]: Uploading piece... Aug 19 04:27:13.634340118 (251h0m54.365607737s) [upload=261095]: Next returned nil segment Aug 19 04:27:13.634350086 (251h0m54.365617706s) [upload=261095]: Waiting for error group managing segments... Aug 19 04:27:13.668785286 (251h0m54.400052907s) [noise=true , address=79.127.220.101:4060 , piece_id=D43XCO3SJ3FCN35UH527HT4OADLQ3YLIHBSTX5VA7QCNURJCKXYQ, seg_pos={0 0}, upload=261095]: Done uploading piece. err: <nil> Aug 19 04:27:13.715717613 (251h0m54.446985243s) [noise=true , address=79.127.201.215:4359 , piece_id=DTTG7MKC5UF24VXXMPJLYKY722VFD42LGCO4226ESGPUYLKS2ENQ, seg_pos={0 0}, upload=261095]: Done uploading piece. err: <nil> Aug 19 04:27:14.051670408 (251h0m54.782938058s) [noise=true , address=66.23.193.175:4562 , piece_id=42OPOWAZZJPMZ6YZKAWNRY7AUZQYMU5T6MWRXXQB6YOBY2UA4C7A, seg_pos={0 0}, upload=261095]: Done uploading piece. err: <nil> Aug 19 04:28:13.405247986 (251h1m54.136515637s) [noise=true , address=77.90.31.17:4783 , piece_id=T4LBFWMNNHMRK5JYMO77QPQXPLXJYEZB3FAWLSEHJJJ5M2OEIKZA, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:155fvDXZdpQeHetitv17WCVVrP1bGswdoqJECQLSe66kXRhBPo, address:77.90.31.17:4783): protocol: write tcp 5.161.89.252:31024->77.90.31.17:4783: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.405323959 (251h1m54.136591609s) [noise=true , address=104.36.82.23:4450 , piece_id=YWNLBVWNS2EYJWRB5TKG6JH4APUPX2652JZHXN5AFLQGPREOPCCQ, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:12XE5kZtVU6FeUR5NF2mhwypKiJahTUyt4qtRbo3PUJp6T5sdms, address:104.36.82.23:4450): protocol: rpc: dial tcp 104.36.82.23:4450: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.405377069 (251h1m54.13664472s) [noise=true , address=104.36.82.13:4211 , piece_id=WQ2ZWJE2TTUCEBN2X7REPVB3GCB2TMZEMBFNBRKGRON5FDPVUWMA, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:12dANoYTygpcpWfCcAJtsnVBFWSekLhDjheAXnsaYMChRYAm2qc, address:104.36.82.13:4211): protocol: rpc: dial tcp 104.36.82.13:4211: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.405426041 (251h1m54.136693701s) [noise=true , address=104.36.82.60:4362 , piece_id=TW6K6SDKOUX22BGG6A62TJBDICICVLL7OBBXYGRWW3EDGAB5WB3Q, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:12238rvPqrDXBowLsUiKTykdZFgfyq4fX9YdaeLa52sQJCkRMHM, address:104.36.82.60:4362): protocol: rpc: dial tcp 104.36.82.60:4362: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.405475665 (251h1m54.136743315s) [noise=true , address=45.91.116.7:4044 , piece_id=GRFMKZOAXAOABXKQ63QOUBKJNC35BVEMFKAJKST464N6EEBA7F3Q, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:12b9DdnzjhU7zj2RSCba3ZWS7AZbZZ4YmDDF4QRq6dZC6YfskNz, address:45.91.116.7:4044): protocol: write tcp 5.161.89.252:55318->45.91.116.7:4044: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.405895634 (251h1m54.137163285s) [noise=true , address=77.90.31.11:4570 , piece_id=XX3VRB5M5XUKKB3CZQH2EJTLQ7WLSBH2I6QWOTCDFYR4MRP2URGQ, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, address:77.90.31.11:4570): protocol: rpc: dial tcp 77.90.31.11:4570: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.405982086 (251h1m54.137249737s) [noise=true , address=45.91.116.12:4230 , piece_id=ARSPLOLCSYXOJM3P2SBZ2I5OLBG4HA7IAGTLJNPLFUHU2DCVNQWQ, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:127RqMv3h2jS5V4nVqPmi3BDwT9gdJBC93EvyA8VXf5w77yiAQP, address:45.91.116.12:4230): protocol: rpc: dial tcp 45.91.116.12:4230: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.406028685 (251h1m54.137296335s) [noise=true , address=45.91.116.4:4971 , piece_id=WXVSH5RSOWSZ23NNPF543QZ4P3TWUI7AHGGQZTWBVT4PGIDJWYMA, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:1mAbf2K1TfQwCpEET5ndPZxmHxP7NaLDPPWowiy9Yrvzv4QvMV, address:45.91.116.4:4971): protocol: rpc: dial tcp 45.91.116.4:4971: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.406115558 (251h1m54.137383207s) [noise=true , address=104.36.82.5:4864 , piece_id=PL662EVJ62ELPCWGVOJAIRGXPHTWZZHC62FHS5ELHXX6DHECJWMQ, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:12XXH8TYK6Qfma867943QYYXycyL6osQhcQYEjdMdJVTUDfda2u, address:104.36.82.5:4864): protocol: rpc: dial tcp 104.36.82.5:4864: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.406167846 (251h1m54.137435496s) [noise=true , address=77.90.31.13:4653 , piece_id=YXZA5ZWYCGC2IK5DMREOJAIKOB2CWXSYX7P4UKTGL5VOHUXTTXEQ, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:12eaTnUhynF1XeuvMr68SjMyYKM9rLj5tShzpViHcMSjvMs9EBF, address:77.90.31.13:4653): protocol: write tcp 5.161.89.252:10232->77.90.31.13:4653: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.406219332 (251h1m54.137486982s) [noise=true , address=77.90.31.16:4768 , piece_id=G6MRDCVXYYZSJ6ZW5LREMO7V7LIGG4X4SJTCJD6PENW7M5JQXOKA, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:12UchewmtxBrtSZSpVAJFdZmcTsQVQxkjK9re6cgUGqDhyonQeF, address:77.90.31.16:4768): protocol: rpc: dial tcp 77.90.31.16:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.406264037 (251h1m54.137531687s) [noise=true , address=77.90.31.19:4874 , piece_id=ZGRFWI2B4NXMAVR56UG3EIF7USS4AODDVB3FF2HXNVTSAALWJBSA, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:14J8ruKPB6P9YBLPhHpCrcLJt3WBYwNo3fGBeJ2Pdp6JfWs3W4, address:77.90.31.19:4874): protocol: rpc: dial tcp 77.90.31.19:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.406273825 (251h1m54.137541486s) [noise=true , address=104.36.82.15:4289 , piece_id=WV5LXFNRLJYPZB7PTYQHNIGSLKWQVZPYUUVQOGNMIV2NGK7ESQMQ, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:126WPF6MtX7YjuKf73rGJrifdXyd78KY4FdL757qDipGNHBW6uY, address:104.36.82.15:4289): protocol: rpc: dial tcp 104.36.82.15:4289: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.406306046 (251h1m54.137573706s) [noise=true , address=104.36.82.44:4869 , piece_id=E4MMA6JCRBJCMN4OEGDCUODXJDEDF5YPXMREPHNASMXKVGRBZK6Q, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:18CQxjq65r6xVTmNRurSQPzKxj4BoR6cJ8Uq29sTrdh6uXm5sq, address:104.36.82.44:4869): protocol: rpc: dial tcp 104.36.82.44:4869: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.406334730 (251h1m54.137602379s) [noise=true , address=45.91.116.11:4138 , piece_id=J4XXTBBI3XK7PRAQKDZBXICV4FDKCUZMUJS2VDQLWP35BWHC2VLA, seg_pos={0 0}, upload=261095]: Done uploading piece. err: ecclient: upload failed (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU, address:45.91.116.11:4138): protocol: rpc: dial tcp 45.91.116.11:4138: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:13.406390244 (251h1m54.137657894s) [seg_pos={0 0}, upload=261095]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Aug 19 04:28:13.424180241 (251h1m54.155447901s) [upload=261095]: Done uploading segments... Aug 19 04:28:13.424202012 (251h1m54.155469662s) [upload=261095]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 1m0.020979733s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 355.239093ms FAIL (2025-08-19 04:28:13 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 355.259171ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 614.990867ms FAIL (2025-08-19 04:28:13 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 615.020883ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 963.425258ms FAIL (2025-08-19 04:28:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 963.450284ms core uplink eu1
checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites) antiblip: 1 out of 15 is failed (threshold=6) [..........X....] duration: 40.171856ms target: https://static.storj.io/dcs-satellites FAIL (2025-08-19 04:28:12 UTC) orbiter warning: Get "https://static.storj.io/dcs-satellites": dial tcp 34.120.119.150:443: i/o timeout Duration: 40.191563ms core website
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 690.149109ms target: https://ap1.storj.io/login FAIL (2025-08-19 04:28:06 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout Duration: 690.17112ms core satellite ap1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 103.749937ms FAIL (2025-08-19 04:28:04 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 103.764926ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 30.01924473s FAIL (2025-08-19 04:27:59 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 4 (251h1m9.913011315s) [noise=true , address=45.91.116.9:4261 , piece_id=M6GGLKTFRPV4LRT2ZAQQIL7ZD3WM5XW4PZ3XEDPVZKXCOBEMF7WA, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.181905157 (251h1m9.913172787s) [noise=true , address=77.90.31.18:4805 , piece_id=OQXN2AVKXC3PI3G35EZKGSSFUTEA75R247FA65WWPK7ENXJDJ6OQ, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.181985839 (251h1m9.91325346s) [noise=true , address=45.91.116.5:4298 , piece_id=EV42GIOB62J6MWFXR7LJ5GT3ED7BM6TNKY7UC3FTKNLMW2QNLJTA, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.182140640 (251h1m9.91340827s) [noise=true , address=77.90.31.17:4770 , piece_id=N3JGKCUG2K3SW6XGQZRPTHM3JXONEAUGNWB5TE4FFEUSQ2OQUUNA, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.182203058 (251h1m9.913470678s) [noise=true , address=104.36.82.11:4113 , piece_id=4ID2M5ZXBN4UNPNJYKN2AORE7APPRNN3TF2BA4H4WBW57YM2ZD6Q, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.182342840 (251h1m9.91361047s) [noise=true , address=45.91.116.7:4009 , piece_id=ZW5P5FU6GBWVRHHC3TVYEQ7GSQF6BBMPULHBK6JDCHP6HCGXTT7A, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.182447127 (251h1m9.913714757s) [noise=true , address=77.90.31.13:4628 , piece_id=W3WDJ4LPJM6UPKLBDHBAWULLDUEO2ARXHFUPSHIL3KQLHZUM3DCA, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.182552394 (251h1m9.913820014s) [noise=true , address=77.90.31.12:4589 , piece_id=IH66SOGWN72JQDCPS44RHLJ73SLRGTI2UO3A7KAAJTBVDHRA76RQ, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.182729828 (251h1m9.913997458s) [noise=true , address=104.36.82.2:4729 , piece_id=YFTOPNGK34N7N63ZZ7O7EJX2NTNFFEW6K2AI6X4TOKJ2NIIGTIWA, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.182757539 (251h1m9.91402517s) [noise=true , address=45.91.116.12:4225 , piece_id=5ETT3KQXKZ625F7HL4T35KBROJ6MHNQXCR4UZVZ24VE2GZMUWN6A, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.182974879 (251h1m9.914242509s) [noise=true , address=77.90.31.14:4663 , piece_id=K35VCBU25QQ5X4WOBTFX7PQLZSLPRGXERRTOVTV56SBGUJBYAWDA, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.183176227 (251h1m9.914443857s) [noise=true , address=45.91.116.11:4119 , piece_id=6YTZYUOEFOIRN6RYGXYYIQD44NQ2GY5OY7ORPM664RORBLK2BMVA, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:29.184058385 (251h1m9.915326015s) [noise=true , address=104.36.82.12:4150 , piece_id=VGHGODW6BXQ3LW7SX7EIZIYHDJ6JNZYVKTIURMU4R5TA7EVSVBAA, seg_pos={0 0}, upload=261100]: Uploading piece... Aug 19 04:27:59.138142058 (251h1m39.869409718s) [upload=261100]: Next segment err: context deadline exceeded Aug 19 04:27:59.139170571 (251h1m39.870438232s) [noise=true , address=77.90.31.18:4805 , piece_id=OQXN2AVKXC3PI3G35EZKGSSFUTEA75R247FA65WWPK7ENXJDJ6OQ, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: rpc: dial tcp 77.90.31.18:4805: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139299333 (251h1m39.870566983s) [noise=true , address=77.90.31.17:4770 , piece_id=N3JGKCUG2K3SW6XGQZRPTHM3JXONEAUGNWB5TE4FFEUSQ2OQUUNA, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: rpc: dial tcp 77.90.31.17:4770: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139339319 (251h1m39.870606979s) [noise=true , address=77.90.31.13:4628 , piece_id=W3WDJ4LPJM6UPKLBDHBAWULLDUEO2ARXHFUPSHIL3KQLHZUM3DCA, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139405814 (251h1m39.870673474s) [noise=true , address=45.91.116.12:4225 , piece_id=5ETT3KQXKZ625F7HL4T35KBROJ6MHNQXCR4UZVZ24VE2GZMUWN6A, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: rpc: dial tcp 45.91.116.12:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139419279 (251h1m39.870686939s) [noise=true , address=45.91.116.11:4119 , piece_id=6YTZYUOEFOIRN6RYGXYYIQD44NQ2GY5OY7ORPM664RORBLK2BMVA, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139473701 (251h1m39.870741351s) [noise=true , address=104.36.82.12:4150 , piece_id=VGHGODW6BXQ3LW7SX7EIZIYHDJ6JNZYVKTIURMU4R5TA7EVSVBAA, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: rpc: dial tcp 104.36.82.12:4150: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139497175 (251h1m39.870764826s) [noise=true , address=77.90.31.14:4663 , piece_id=K35VCBU25QQ5X4WOBTFX7PQLZSLPRGXERRTOVTV56SBGUJBYAWDA, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: rpc: dial tcp 77.90.31.14:4663: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139521962 (251h1m39.870789612s) [noise=true , address=45.91.116.10:4081 , piece_id=P6ZDVCDVLLHPAPXRNJVEPI22BOSSEAJDDJUQAEP42G23QJLZHDEQ, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: rpc: dial tcp 45.91.116.10:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139549224 (251h1m39.870816874s) [noise=true , address=77.90.31.16:4733 , piece_id=VDN4FFSF3NOFHQ6ZF5YJYNMBEKY5WZNPQGTUNDAJ6J24A4H2WY5Q, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:12TBBdm1hfKVn49KrFVNj3MRbqoanGxJW82ws1iJqMtjRdzJKVf, address:77.90.31.16:4733): protocol: rpc: dial tcp 77.90.31.16:4733: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139566887 (251h1m39.870834537s) [noise=true , address=104.36.82.2:4729 , piece_id=YFTOPNGK34N7N63ZZ7O7EJX2NTNFFEW6K2AI6X4TOKJ2NIIGTIWA, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: rpc: dial tcp 104.36.82.2:4729: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139601512 (251h1m39.870869162s) [noise=true , address=45.91.116.9:4261 , piece_id=M6GGLKTFRPV4LRT2ZAQQIL7ZD3WM5XW4PZ3XEDPVZKXCOBEMF7WA, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: rpc: dial tcp 45.91.116.9:4261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139609917 (251h1m39.870877568s) [noise=true , address=45.91.116.6:4975 , piece_id=7NMO6DYIVVX7C5QEBQAUDDMLXCTBCXHNJDWGCBXGYCSWX2YS7QDA, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139650474 (251h1m39.870918134s) [noise=true , address=45.91.116.5:4298 , piece_id=EV42GIOB62J6MWFXR7LJ5GT3ED7BM6TNKY7UC3FTKNLMW2QNLJTA, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: rpc: dial tcp 45.91.116.5:4298: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139656335 (251h1m39.870923985s) [noise=true , address=45.91.116.7:4009 , piece_id=ZW5P5FU6GBWVRHHC3TVYEQ7GSQF6BBMPULHBK6JDCHP6HCGXTT7A, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: rpc: dial tcp 45.91.116.7:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139698294 (251h1m39.870965944s) [noise=true , address=104.36.82.11:4113 , piece_id=4ID2M5ZXBN4UNPNJYKN2AORE7APPRNN3TF2BA4H4WBW57YM2ZD6Q, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: rpc: dial tcp 104.36.82.11:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139716858 (251h1m39.870984508s) [noise=true , address=77.90.31.12:4589 , piece_id=IH66SOGWN72JQDCPS44RHLJ73SLRGTI2UO3A7KAAJTBVDHRA76RQ, seg_pos={0 0}, upload=261100]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 5.161.89.252:53190->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:59.139747626 (251h1m39.871015286s) [seg_pos={0 0}, upload=261100]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.019263755s core uplink us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 9.177875ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-19 04:27:54 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34965->127.0.0.1:53: i/o timeout Duration: 9.202462ms edge linksharing us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.016404392s FAIL (2025-08-19 04:27:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 14 but got 0) ======LOGS====== Aug 19 04:26:49.011905091 (251h0m29.743172721s) [upload=261089]: Starting upload Aug 19 04:26:49.011999660 (251h0m29.74326729s) [upload=261089]: Done starting upload Aug 19 04:26:49.012126638 (251h0m29.743394268s) [upload=261089]: Uploading segments... Aug 19 04:26:49.012229883 (251h0m29.743497513s) [upload=261089]: Got next segment. Inline: false Aug 19 04:26:49.012261482 (251h0m29.743529102s) [upload=261089]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:26:49.012265038 (251h0m29.743532659s) [upload=261089]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:26:49.037089871 (251h0m29.768357491s) [seg_pos={0 0}, upload=261089]: Begin upload segment... Aug 19 04:26:49.037119216 (251h0m29.768386846s) [seg_pos={0 0}, upload=261089]: Done begin upload segment. Aug 19 04:26:49.037137190 (251h0m29.768404811s) [noise=true , address=45.91.116.14:4204 , piece_id=ZCRX4CEZTTL4B2IS75NRNB73IDTLISBVWWBOBRJ4ZKT5JU3PJKRQ, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.037188176 (251h0m29.768455796s) [noise=true , address=104.36.82.23:4446 , piece_id=4YD74EUWO4BDZLICG5JFACJ3V32AMYQTKUFBGFMGHWZX2DJ7THDA, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.037418369 (251h0m29.768685999s) [noise=true , address=77.90.31.17:4781 , piece_id=6CWV7MXO44MU5ND2CEHGAGBHSEHRANTVV2LCUDWOTUB4H4AIECOQ, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.037459396 (251h0m29.768727026s) [noise=true , address=104.36.82.5:4841 , piece_id=DUA2MFYP5GPATSNC4GTDEPQHT7EXOEN4VLCEJE74ZCJTZYY62D7Q, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.037672416 (251h0m29.768940036s) [noise=true , address=77.90.31.16:4767 , piece_id=3FTTSPVM7SPXEQUCD5TFLRZZTYLEMH5EYHGC6UKHKYCXIOOKBA6Q, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.037679079 (251h0m29.768946709s) [noise=true , address=45.91.116.8:4068 , piece_id=KMPEXPA4QYVHNXDMVHF4XTJKAK76CW2LTU7RCYGVJWLWC7GTSOLQ, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.037882381 (251h0m29.769150011s) [noise=true , address=104.36.82.13:4212 , piece_id=L5EROHATKNIUEBSLDJQPURVVZ2IBP4EBGQGNCL45TIAY46JBKGMA, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.037961730 (251h0m29.76922936s) [noise=true , address=77.90.31.13:4633 , piece_id=CXORAQKGUWKT6Z24HVIVF3NB7MGPV65EAHNZG4E5XV2KSNKEQDIQ, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.038102475 (251h0m29.769370094s) [noise=true , address=77.90.31.18:4835 , piece_id=DZ56EJKQORUWSKIQHC6BSXG7HWRQR46Z4EZXGYZWABON6OJAKVWA, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.038251024 (251h0m29.769518654s) [noise=true , address=45.91.116.12:4249 , piece_id=BDROAYKYLDGOSVFDCA2P6Y75RYDL2RI7BROF7SWGCLJT24YA5T2A, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.038308663 (251h0m29.769576293s) [noise=true , address=77.90.31.14:4686 , piece_id=P5BXXI2BO3DK4WHBVX557RXKPDK5JOJEMQVHECDHF6A77KMSZ5PQ, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.038509961 (251h0m29.769777581s) [noise=true , address=104.36.82.60:4350 , piece_id=OMCAD6FD5TBCBC27K4TZGJBTHWGIHAZBIOFXRYJIFNFVEMHXW2VQ, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.038519198 (251h0m29.769786818s) [noise=true , address=104.36.82.44:4872 , piece_id=TMUN2HUY64BRKUUQ4VXUKFNOY47XPDJN23G6GUM4URWYL27NJSEA, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.038809204 (251h0m29.770076823s) [noise=true , address=77.90.31.11:4575 , piece_id=KNPEYZMWKV7OIL7KF4CPEFJK74KDM7H3ZYZMJFJZLOVYNMLLMPNQ, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.039064913 (251h0m29.770332544s) [noise=true , address=45.91.116.11:4144 , piece_id=VU4AE7CPK44R2E6GHCM5IJML6KIDJIM62CMWMTHRSCLRVHGZAENA, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.039309173 (251h0m29.770576793s) [noise=true , address=104.36.82.10:4100 , piece_id=2AZETJDUL6SU7TNRPT2UATNNMI3YBX3QO7GCAJVO2FEQQUZKOA5A, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.039546961 (251h0m29.770814591s) [noise=true , address=77.90.31.21:4885 , piece_id=MBBPODC2MSPMC345LOT76Y7OFZT3FRKQOG22Z4FJPODPBBPIAK5Q, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:26:49.040610920 (251h0m29.771878551s) [noise=true , address=45.91.116.9:4274 , piece_id=7T2VQ3FJJG7NU3RIY4NZXI2AZAVXAA4AXC4K4C4P446TW4CXAFFQ, seg_pos={0 0}, upload=261089]: Uploading piece... Aug 19 04:27:48.994071984 (251h1m29.725339624s) [upload=261089]: Next segment err: context deadline exceeded Aug 19 04:27:48.994355138 (251h1m29.725622778s) [noise=true , address=45.91.116.12:4249 , piece_id=BDROAYKYLDGOSVFDCA2P6Y75RYDL2RI7BROF7SWGCLJT24YA5T2A, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12ghkFFJVqKzG9GbJjYVtcadUCr64bCY8dkEjbYGSShMG9e7WvA, address:45.91.116.12:4249): protocol: write tcp 5.161.89.252:50562->45.91.116.12:4249: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994416552 (251h1m29.725684203s) [noise=true , address=104.36.82.60:4350 , piece_id=OMCAD6FD5TBCBC27K4TZGJBTHWGIHAZBIOFXRYJIFNFVEMHXW2VQ, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12byqLui89KiVQB8FetY1aAZAX3Ziy6orZr4DeSgLFjpFQe2CH, address:104.36.82.60:4350): protocol: rpc: dial tcp 104.36.82.60:4350: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994472317 (251h1m29.725739957s) [noise=true , address=77.90.31.11:4575 , piece_id=KNPEYZMWKV7OIL7KF4CPEFJK74KDM7H3ZYZMJFJZLOVYNMLLMPNQ, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:1vQCT2yf3pZep8VeNBcKma579ot9EfWgaNkXQNofKjHTzdCuoc, address:77.90.31.11:4575): protocol: write tcp 5.161.89.252:44112->77.90.31.11:4575: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994583577 (251h1m29.725851227s) [noise=true , address=104.36.82.10:4100 , piece_id=2AZETJDUL6SU7TNRPT2UATNNMI3YBX3QO7GCAJVO2FEQQUZKOA5A, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12Hyc6sbtuPXMLyFzubMcepbJyLyVAGNpkXAmqg73i3sY97dwdW, address:104.36.82.10:4100): protocol: rpc: dial tcp 104.36.82.10:4100: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994644992 (251h1m29.725912642s) [noise=true , address=45.91.116.14:4204 , piece_id=ZCRX4CEZTTL4B2IS75NRNB73IDTLISBVWWBOBRJ4ZKT5JU3PJKRQ, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:1nP8xospdMuDEh3em5K6iBnh8bHXqLhvHy4pHm9m8Lnj4kEH2X, address:45.91.116.14:4204): protocol: write tcp 5.161.89.252:14528->45.91.116.14:4204: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994690026 (251h1m29.725957677s) [noise=true , address=104.36.82.23:4446 , piece_id=4YD74EUWO4BDZLICG5JFACJ3V32AMYQTKUFBGFMGHWZX2DJ7THDA, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:104.36.82.23:4446): protocol: write tcp 5.161.89.252:18678->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994732597 (251h1m29.726000248s) [noise=true , address=77.90.31.16:4767 , piece_id=3FTTSPVM7SPXEQUCD5TFLRZZTYLEMH5EYHGC6UKHKYCXIOOKBA6Q, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:1D4NHwWuUoNH51rQCv9jdJ4oKKHxMQJ2ZZJfrSZLWYWJJWipWK, address:77.90.31.16:4767): protocol: write tcp 5.161.89.252:52800->77.90.31.16:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994773784 (251h1m29.726041424s) [noise=true , address=77.90.31.21:4885 , piece_id=MBBPODC2MSPMC345LOT76Y7OFZT3FRKQOG22Z4FJPODPBBPIAK5Q, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12TfMGrvCMPvQ9ZC1pVoDqjFnUHXtzwwnZB6pCV1em4pdmbK2MP, address:77.90.31.21:4885): protocol: write tcp 5.161.89.252:55988->77.90.31.21:4885: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994804251 (251h1m29.726071902s) [noise=true , address=77.90.31.14:4686 , piece_id=P5BXXI2BO3DK4WHBVX557RXKPDK5JOJEMQVHECDHF6A77KMSZ5PQ, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12oiaCxBrU4T1tjfF18931ThYP82bK4V2qDG37nUUnMBm1EF1Cx, address:77.90.31.14:4686): protocol: write tcp 5.161.89.252:49446->77.90.31.14:4686: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994853284 (251h1m29.726120924s) [noise=true , address=45.91.116.9:4274 , piece_id=7T2VQ3FJJG7NU3RIY4NZXI2AZAVXAA4AXC4K4C4P446TW4CXAFFQ, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12g6jFa38dTz5UdgsQaEuM2MSH1H7cxaysWsVmbHkM2Dd2W2iDb, address:45.91.116.9:4274): protocol: write tcp 5.161.89.252:60318->45.91.116.9:4274: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994913106 (251h1m29.726180756s) [noise=true , address=77.90.31.17:4781 , piece_id=6CWV7MXO44MU5ND2CEHGAGBHSEHRANTVV2LCUDWOTUB4H4AIECOQ, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT, address:77.90.31.17:4781): protocol: write tcp 5.161.89.252:53472->77.90.31.17:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.994981716 (251h1m29.726249366s) [noise=true , address=104.36.82.5:4841 , piece_id=DUA2MFYP5GPATSNC4GTDEPQHT7EXOEN4VLCEJE74ZCJTZYY62D7Q, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12ndNj9Dy8qQSbHXwVWw31sz19ki1qy6Zgetjvj1A5Q3odkzmDm, address:104.36.82.5:4841): protocol: write tcp 5.161.89.252:44006->104.36.82.5:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.995134162 (251h1m29.726401811s) [noise=true , address=45.91.116.8:4068 , piece_id=KMPEXPA4QYVHNXDMVHF4XTJKAK76CW2LTU7RCYGVJWLWC7GTSOLQ, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:1jN6HbQbPBjk645swQd33LrTfb3LbAWk1dPNXU45zFrgmm6Q82, address:45.91.116.8:4068): protocol: rpc: dial tcp 45.91.116.8:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.995185448 (251h1m29.726453099s) [noise=true , address=104.36.82.13:4212 , piece_id=L5EROHATKNIUEBSLDJQPURVVZ2IBP4EBGQGNCL45TIAY46JBKGMA, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:1itAUtWeFERY4AKhPxE2CRwymp8qNC6wu6uhPt2n6aK58LRu24, address:104.36.82.13:4212): protocol: write tcp 5.161.89.252:30136->104.36.82.13:4212: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.995326814 (251h1m29.726594464s) [noise=true , address=77.90.31.13:4633 , piece_id=CXORAQKGUWKT6Z24HVIVF3NB7MGPV65EAHNZG4E5XV2KSNKEQDIQ, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs, address:77.90.31.13:4633): protocol: write tcp 5.161.89.252:42964->77.90.31.13:4633: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.995380065 (251h1m29.726647715s) [noise=true , address=77.90.31.18:4835 , piece_id=DZ56EJKQORUWSKIQHC6BSXG7HWRQR46Z4EZXGYZWABON6OJAKVWA, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12hAQp2Zr7WSaQSTCZf5pwSyuBHHSrZWq5EVz5hFvSA5ddWebqg, address:77.90.31.18:4835): protocol: rpc: dial tcp 77.90.31.18:4835: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.995403919 (251h1m29.726671569s) [noise=true , address=104.36.82.44:4872 , piece_id=TMUN2HUY64BRKUUQ4VXUKFNOY47XPDJN23G6GUM4URWYL27NJSEA, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12dNdm2kAok8jFgbYE24oXUL9KCJVDDiinLUJgDSYEY3fTEBJec, address:104.36.82.44:4872): protocol: write tcp 5.161.89.252:16550->104.36.82.44:4872: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.995431060 (251h1m29.7266987s) [noise=true , address=45.91.116.11:4144 , piece_id=VU4AE7CPK44R2E6GHCM5IJML6KIDJIM62CMWMTHRSCLRVHGZAENA, seg_pos={0 0}, upload=261089]: Done uploading piece. err: ecclient: upload failed (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA, address:45.91.116.11:4144): protocol: write tcp 5.161.89.252:62796->45.91.116.11:4144: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:48.995455195 (251h1m29.726722846s) [seg_pos={0 0}, upload=261089]: Done waiting for segment. successful: 0 optimal: 14 errs: <nil> Duration: 1m0.016418167s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 4.819376854s FAIL (2025-08-19 04:27:49 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.819402323s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 335.55217ms FAIL (2025-08-19 04:27:44 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 335.567109ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 108.705203ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-19 04:27:43 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 108.732265ms edge gateway vhost bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 911.479963ms FAIL (2025-08-19 04:27:43 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 911.504199ms edge authservice http bgp ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 169.58446ms FAIL (2025-08-19 04:27:31 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 169.60461ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 913.084754ms FAIL (2025-08-19 04:27:28 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 913.103019ms core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 698.848307ms target: https://ap1.storj.io/login FAIL (2025-08-19 04:27:26 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout Duration: 698.871781ms core satellite ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.296235976s FAIL (2025-08-19 04:27:25 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 1.296258007s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 30.016360333s FAIL (2025-08-19 04:27:18 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== 31.19:4843 , piece_id=ZFCJ47CKXNZW5IHBBOVKDXC2WYMSNRK7YBKNUP3UAKEGMNTL7NRA, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.170474144 (251h0m28.901741795s) [noise=true , address=45.91.116.9:4261 , piece_id=2QFPAWXRYRMVFSDLUYNF4JDCFMBQIQMIIMCD72ZXB674FLPZWCZA, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.170843538 (251h0m28.902111188s) [noise=true , address=45.91.116.4:4937 , piece_id=6IXIVQY6ETYFFAK6QYJGG66VNSVA6RKME4EXUZKUBHWBRXEB6LGQ, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.170993791 (251h0m28.902261441s) [noise=true , address=104.36.82.6:4874 , piece_id=QNJVITXDL6376CGR6CYK7665QBO7GQKEZ2UUWK6L467TDLUPCZBA, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.171334131 (251h0m28.90260178s) [noise=true , address=77.90.31.11:4555 , piece_id=SZETRKCKSKHNEDOEAAJZRU4Y4F44GNOMFDFZ2M76WW2TCKFL7IWQ, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.171710267 (251h0m28.902977918s) [noise=true , address=104.36.82.3:4765 , piece_id=7W56S5ZEIXOE7NNAZFKSD2BA5NJZLAFDNRDLG7APQIX4ADG6H42A, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.172137220 (251h0m28.903404871s) [noise=true , address=77.90.31.19:4841 , piece_id=KPJYOQMCMXVS64HIEP3PU7UXC7JY26VAOXL6LJYSMJNUDO2AL6GA, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.172504681 (251h0m28.903772332s) [noise=true , address=45.91.116.5:4297 , piece_id=YXJ2GNSQMZNO4WNEU7QUO33XPZWUQN33E5CUWC2LM4N2VSJHBRCQ, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.172968123 (251h0m28.904235773s) [noise=true , address=104.36.82.5:4837 , piece_id=TZLMI2XE7EWX5E3NYXXL4PJ6CMDBZS5EYESWK2W5P7RQY22NBPEA, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.173327127 (251h0m28.904594777s) [noise=true , address=104.36.82.10:4077 , piece_id=VFOJRLUXZHITDWRBFO7BFASHUNF6LLLJ6DAHVVGDYVMHGB63TXLA, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.173786021 (251h0m28.905053721s) [noise=true , address=77.90.31.10:4518 , piece_id=JZLRJQZDCAPXHIJQF5D2KJK67EZO2COP4TU7ZLE6ROQPR4FRZ36Q, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.174264921 (251h0m28.905532611s) [noise=true , address=77.90.31.18:4807 , piece_id=PPWBOTLR24Q7VFQEQJYKNWX3KZL4EH5VO5UK7LVISAFRJMSQJS5Q, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:26:48.174690802 (251h0m28.905958482s) [noise=true , address=45.91.116.7:4011 , piece_id=44ORO37DLLBH7LP4HEH2Y5F4AH5VBCUBKDKZSCWWPDIEHB3MFYGA, seg_pos={0 0}, upload=261088]: Uploading piece... Aug 19 04:27:18.127856994 (251h0m58.859124645s) [upload=261088]: Next segment err: context deadline exceeded Aug 19 04:27:18.128821298 (251h0m58.860088948s) [noise=true , address=77.90.31.19:4843 , piece_id=ZFCJ47CKXNZW5IHBBOVKDXC2WYMSNRK7YBKNUP3UAKEGMNTL7NRA, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: rpc: dial tcp 77.90.31.19:4843: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.128876361 (251h0m58.860144011s) [noise=true , address=45.91.116.7:4011 , piece_id=44ORO37DLLBH7LP4HEH2Y5F4AH5VBCUBKDKZSCWWPDIEHB3MFYGA, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: rpc: dial tcp 45.91.116.7:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.128922718 (251h0m58.860190368s) [noise=true , address=45.91.116.9:4261 , piece_id=2QFPAWXRYRMVFSDLUYNF4JDCFMBQIQMIIMCD72ZXB674FLPZWCZA, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: rpc: dial tcp 45.91.116.9:4261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.128984674 (251h0m58.860252325s) [noise=true , address=77.90.31.19:4841 , piece_id=KPJYOQMCMXVS64HIEP3PU7UXC7JY26VAOXL6LJYSMJNUDO2AL6GA, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129050770 (251h0m58.860318419s) [noise=true , address=45.91.116.5:4297 , piece_id=YXJ2GNSQMZNO4WNEU7QUO33XPZWUQN33E5CUWC2LM4N2VSJHBRCQ, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129095223 (251h0m58.860362872s) [noise=true , address=77.90.31.10:4518 , piece_id=JZLRJQZDCAPXHIJQF5D2KJK67EZO2COP4TU7ZLE6ROQPR4FRZ36Q, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: rpc: dial tcp 77.90.31.10:4518: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129136149 (251h0m58.860403789s) [noise=true , address=45.91.116.12:4227 , piece_id=FHO74X3LHX4QOC3U4RCHL5AE76DGEGU77WUD2JJVL77NMXAQFN5A, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: rpc: dial tcp 45.91.116.12:4227: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129208956 (251h0m58.860476606s) [noise=true , address=104.36.82.6:4874 , piece_id=QNJVITXDL6376CGR6CYK7665QBO7GQKEZ2UUWK6L467TDLUPCZBA, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: write tcp 5.161.89.252:16922->104.36.82.6:4874: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129252218 (251h0m58.860519858s) [noise=true , address=77.90.31.18:4807 , piece_id=PPWBOTLR24Q7VFQEQJYKNWX3KZL4EH5VO5UK7LVISAFRJMSQJS5Q, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: rpc: dial tcp 77.90.31.18:4807: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129338610 (251h0m58.860606261s) [noise=true , address=45.91.116.4:4937 , piece_id=6IXIVQY6ETYFFAK6QYJGG66VNSVA6RKME4EXUZKUBHWBRXEB6LGQ, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: rpc: dial tcp 45.91.116.4:4937: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129426285 (251h0m58.860693934s) [noise=true , address=77.90.31.11:4555 , piece_id=SZETRKCKSKHNEDOEAAJZRU4Y4F44GNOMFDFZ2M76WW2TCKFL7IWQ, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129499603 (251h0m58.860767253s) [noise=true , address=45.91.116.6:4974 , piece_id=PB4UA3Y4ZKNMZTJNPWMWGEST2MAKOMROI2JJGAFQQPDTX5APYREA, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: rpc: dial tcp 45.91.116.6:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129521825 (251h0m58.860789475s) [noise=true , address=104.36.82.5:4837 , piece_id=TZLMI2XE7EWX5E3NYXXL4PJ6CMDBZS5EYESWK2W5P7RQY22NBPEA, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129565026 (251h0m58.860832676s) [noise=true , address=104.36.82.3:4765 , piece_id=7W56S5ZEIXOE7NNAZFKSD2BA5NJZLAFDNRDLG7APQIX4ADG6H42A, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:104.36.82.3:4765): protocol: rpc: dial tcp 104.36.82.3:4765: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129600252 (251h0m58.860867902s) [noise=true , address=104.36.82.10:4077 , piece_id=VFOJRLUXZHITDWRBFO7BFASHUNF6LLLJ6DAHVVGDYVMHGB63TXLA, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:104.36.82.10:4077): protocol: rpc: dial tcp 104.36.82.10:4077: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129612274 (251h0m58.860879924s) [noise=true , address=104.36.82.15:4259 , piece_id=R7IU5HIURTDAGDMYYPEDSBDQLKHERSROVVV67GNABULAI5K2Q2RA, seg_pos={0 0}, upload=261088]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: write tcp 5.161.89.252:34778->104.36.82.15:4259: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:18.129628054 (251h0m58.860895694s) [seg_pos={0 0}, upload=261088]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.016378056s core uplink us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 839.017192ms FAIL (2025-08-19 04:27:14 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 839.040385ms edge authservice http bgp eu1
checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites) antiblip: 1 out of 15 is failed (threshold=6) [...........X...] duration: 49.221981ms target: https://static.storj.io/dcs-satellites FAIL (2025-08-19 04:27:12 UTC) orbiter warning: Get "https://static.storj.io/dcs-satellites": dial tcp 34.120.119.150:443: i/o timeout Duration: 49.240685ms core website
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 203.250164ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-08-19 04:27:10 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 203.278607ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 924.749875ms FAIL (2025-08-19 04:27:09 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 924.782937ms core uplink eu1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 46.423229ms FAIL (2025-08-19 04:27:08 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 46.450309ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.032229814s FAIL (2025-08-19 04:27:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 3) ======LOGS====== piece... Aug 19 04:26:03.333175022 (250h59m44.064442672s) [noise=true , address=104.36.82.60:4351 , piece_id=6CKDU5DNUS7KJXIUDAW2IKM42LIT5KLFQGGJS7FSWEU4ESG6LJHQ, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.333239263 (250h59m44.064506913s) [noise=true , address=45.91.116.8:4075 , piece_id=G2EZ2HHUGAS2UGJIGNOPN5BOUROECQR532ATACMPK45DZVMDLTPA, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.333585584 (250h59m44.064853234s) [noise=true , address=79.127.201.215:4356 , piece_id=3TKSSLHFNQRNFO33BGLASHSUWO73ZQ5QSKGF6FHSE4LIX536IB4Q, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.333799597 (250h59m44.065067246s) [noise=true , address=45.91.116.7:4014 , piece_id=V6S47JBWPS623EJ4T7ACXIAA4PM4FRTBA7356ZIS6VFTVTAN7E3A, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.334038576 (250h59m44.065306225s) [noise=true , address=104.36.82.36:4632 , piece_id=QGB2WIR4ZX4UXELZUP4XRHB5PRSUNJQUPGJHVYALC4WQPTRWQNOA, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.334271112 (250h59m44.065538763s) [noise=true , address=104.36.82.19:4435 , piece_id=JTNJXJAVGKHJCVDEZMULBTE2PJPIX6JN63OEZOBAUIOYQRFTJYJQ, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.334452975 (250h59m44.065720695s) [noise=true , address=77.90.31.19:4861 , piece_id=BPVELWOGO2MLZZGF56QWAKTTNAZE63DKOAPJR7XVOFSXQI2TPNDA, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.334710319 (250h59m44.065977968s) [noise=true , address=104.36.82.5:4858 , piece_id=VLJMWISNKPEXTS2H3GX2SLSHBTCTI2K3GELUHUH4SGMKLHNEZJUA, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.334846324 (250h59m44.066113964s) [noise=true , address=104.36.82.44:4896 , piece_id=33FGYU5VHRCADXGDHWENPGWFKGJYKJCNE2SFP35ZZCUHQEC43V3A, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.335093178 (250h59m44.066360829s) [noise=true , address=104.36.82.44:4901 , piece_id=OYMVVEVZISLURNBWA7VOCSOTH3LY7QGDOBWJKFQ4ZSKCJ4WNSI7Q, seg_pos={0 0}, upload=261078]: Uploading piece... Aug 19 04:26:03.487730015 (250h59m44.218997645s) [upload=261078]: Next returned nil segment Aug 19 04:26:03.487741427 (250h59m44.219009057s) [upload=261078]: Waiting for error group managing segments... Aug 19 04:26:03.521739025 (250h59m44.253006655s) [noise=true , address=79.127.220.101:4060 , piece_id=GFE4AZATGHSRDYETO3M73YLAEHHTTP7ZMNXSRZ6KPLTPQPQCH5RQ, seg_pos={0 0}, upload=261078]: Done uploading piece. err: <nil> Aug 19 04:26:03.582889022 (250h59m44.314156652s) [noise=true , address=79.127.201.215:4356 , piece_id=3TKSSLHFNQRNFO33BGLASHSUWO73ZQ5QSKGF6FHSE4LIX536IB4Q, seg_pos={0 0}, upload=261078]: Done uploading piece. err: <nil> Aug 19 04:26:03.924408745 (250h59m44.655676395s) [noise=true , address=66.23.193.175:4553 , piece_id=MR3PEZQAMF4CDDHHAU2YKBLFBH354IBWFD3Q5PDJHVHNFGYXQLWA, seg_pos={0 0}, upload=261078]: Done uploading piece. err: <nil> Aug 19 04:27:03.289641045 (251h0m44.020908675s) [noise=true , address=77.90.31.17:4779 , piece_id=HKBBQEAEI65RMPERFPM2HH6GEDKYPPQ26BAPPTNT3QU63ZVUYVMQ, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:12HfiiWLGzNiY2CiGyBUWZ11t1sRY4duPLvAMdfgi4jMetx2ePN, address:77.90.31.17:4779): protocol: rpc: dial tcp 77.90.31.17:4779: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289663517 (251h0m44.020931147s) [noise=true , address=45.91.116.7:4014 , piece_id=V6S47JBWPS623EJ4T7ACXIAA4PM4FRTBA7356ZIS6VFTVTAN7E3A, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:1yVYauHmJiuAd6ZE6CfQvqZY2MzJTZnNA69CWLm9caDiX2fjDH, address:45.91.116.7:4014): protocol: rpc: dial tcp 45.91.116.7:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289700176 (251h0m44.020967806s) [noise=true , address=45.91.116.4:4963 , piece_id=MB5DVVFDBJ76LMBRF3SXTO5NFCRD67OL6GOSUK3MDH7KUA7X32PQ, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:1Eki7jYegwvkdixR5pznQBbSeJPn9GjGofxnUApidQF4kRNBK5, address:45.91.116.4:4963): protocol: rpc: dial tcp 45.91.116.4:4963: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289728560 (251h0m44.02099618s) [noise=true , address=104.36.82.44:4896 , piece_id=33FGYU5VHRCADXGDHWENPGWFKGJYKJCNE2SFP35ZZCUHQEC43V3A, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o, address:104.36.82.44:4896): protocol: rpc: dial tcp 104.36.82.44:4896: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289744750 (251h0m44.02101238s) [noise=true , address=104.36.82.19:4435 , piece_id=JTNJXJAVGKHJCVDEZMULBTE2PJPIX6JN63OEZOBAUIOYQRFTJYJQ, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:12vj2Ez6zARZEpXzKwRBFVEtGjqs6uk9zDSAaTcX1PzzUfytwUP, address:104.36.82.19:4435): protocol: rpc: dial tcp 104.36.82.19:4435: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289756513 (251h0m44.021024143s) [noise=true , address=104.36.82.44:4901 , piece_id=OYMVVEVZISLURNBWA7VOCSOTH3LY7QGDOBWJKFQ4ZSKCJ4WNSI7Q, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:1FHE84zvBb1MKwB1Ht7puTafgQxDEvPt4mYqkYVSSufAMpWQA1, address:104.36.82.44:4901): protocol: rpc: dial tcp 104.36.82.44:4901: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289779615 (251h0m44.021047236s) [noise=true , address=104.36.82.11:4125 , piece_id=EPPDQA5HXAG64IDMWFMDJAMKZIYRRBORUISONB2HD67HEPC4IUGQ, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT, address:104.36.82.11:4125): protocol: rpc: dial tcp 104.36.82.11:4125: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289807458 (251h0m44.021075078s) [noise=true , address=77.90.31.11:4571 , piece_id=FEVMUGDPQGPRBT5HC2W5GM36SLBI2EGJSU4KH65HQ273F4BXFPJQ, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy, address:77.90.31.11:4571): protocol: rpc: dial tcp 77.90.31.11:4571: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289817547 (251h0m44.021085167s) [noise=true , address=104.36.82.18:4372 , piece_id=Y3FU5AVP6TSCLSWBS7JQ3JHBGPKMW6ERAC2QBRDPAEBTZFOBCYTQ, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:1fchsL2RkNzQhjmtJgKigZUHhrVgb48PohuJNFk8GmKiVax44T, address:104.36.82.18:4372): protocol: rpc: dial tcp 104.36.82.18:4372: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289840049 (251h0m44.021107669s) [noise=true , address=104.36.82.36:4632 , piece_id=QGB2WIR4ZX4UXELZUP4XRHB5PRSUNJQUPGJHVYALC4WQPTRWQNOA, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC, address:104.36.82.36:4632): protocol: rpc: dial tcp 104.36.82.36:4632: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289847182 (251h0m44.021114802s) [noise=true , address=104.36.82.60:4351 , piece_id=6CKDU5DNUS7KJXIUDAW2IKM42LIT5KLFQGGJS7FSWEU4ESG6LJHQ, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:16aJgn61bhumVFmXfTv8YUi5JfZedtBqadv8yVcSEjgfgUxuDg, address:104.36.82.60:4351): protocol: rpc: dial tcp 104.36.82.60:4351: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289870687 (251h0m44.021138307s) [noise=true , address=77.90.31.19:4861 , piece_id=BPVELWOGO2MLZZGF56QWAKTTNAZE63DKOAPJR7XVOFSXQI2TPNDA, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:12MXMA4zbRGtLCJaAfF2BchSfazrAR7ToZnpazHkNEapzzm44QQ, address:77.90.31.19:4861): protocol: rpc: dial tcp 77.90.31.19:4861: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289877479 (251h0m44.021145109s) [noise=true , address=77.90.31.15:4715 , piece_id=3Q4WX3G35NTBA5X2V7CLVYZ6ECC7SLCNDNA23TO4LXWMWAMVLE4Q, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:12WXsguvsox5t3gJTmYgXxSvS9Wha4DSSzhfadhoASU4see1FCs, address:77.90.31.15:4715): protocol: rpc: dial tcp 77.90.31.15:4715: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289880625 (251h0m44.021148255s) [noise=true , address=45.91.116.8:4075 , piece_id=G2EZ2HHUGAS2UGJIGNOPN5BOUROECQR532ATACMPK45DZVMDLTPA, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:1GHRhMSQiYGrk84jej1nYkPf1A9dxxP36cPc6suGHuVALqXF4r, address:45.91.116.8:4075): protocol: write tcp 5.161.89.252:34916->45.91.116.8:4075: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289884763 (251h0m44.021152393s) [noise=true , address=104.36.82.5:4858 , piece_id=VLJMWISNKPEXTS2H3GX2SLSHBTCTI2K3GELUHUH4SGMKLHNEZJUA, seg_pos={0 0}, upload=261078]: Done uploading piece. err: ecclient: upload failed (node:12PasA9NPExHCQgMSK1E1kz2HHkpXQmWq7LmrwY6sRmf22avri, address:104.36.82.5:4858): protocol: rpc: dial tcp 104.36.82.5:4858: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:27:03.289917695 (251h0m44.021185325s) [seg_pos={0 0}, upload=261078]: Done waiting for segment. successful: 3 optimal: 14 errs: <nil> Aug 19 04:27:03.320583999 (251h0m44.05185162s) [upload=261078]: Done uploading segments... Aug 19 04:27:03.320603316 (251h0m44.051870946s) [upload=261078]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 3) Duration: 1m0.032243589s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 4.648673733s FAIL (2025-08-19 04:26:58 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.648703298s core uplink ap1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 13.367181ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-19 04:26:57 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34965->127.0.0.1:53: i/o timeout Duration: 13.392148ms edge linksharing us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 680.861096ms target: https://ap1.storj.io/login FAIL (2025-08-19 04:26:56 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout Duration: 680.87432ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.015183116s FAIL (2025-08-19 04:26:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 4) ======LOGS====== Aug 19 04:25:48.941252219 (250h59m29.67251987s) [upload=261074]: Starting upload Aug 19 04:25:48.941386721 (250h59m29.672654372s) [upload=261074]: Done starting upload Aug 19 04:25:48.941465009 (250h59m29.672732659s) [upload=261074]: Uploading segments... Aug 19 04:25:48.941852297 (250h59m29.673119957s) [upload=261074]: Got next segment. Inline: false Aug 19 04:25:48.941899657 (250h59m29.673167306s) [upload=261074]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:25:48.941916227 (250h59m29.673183878s) [upload=261074]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:25:48.967179934 (250h59m29.698447595s) [seg_pos={0 0}, upload=261074]: Begin upload segment... Aug 19 04:25:48.967287106 (250h59m29.698554765s) [seg_pos={0 0}, upload=261074]: Done begin upload segment. Aug 19 04:25:48.967522609 (250h59m29.69879027s) [noise=true , address=77.90.31.19:4849 , piece_id=C5VJ53C4ZNR5GXITLCGL66GCRQETUWQ5HMZ4NPRHGEYWD2A3CBIA, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.968593171 (250h59m29.699860821s) [noise=true , address=104.36.82.49:4012 , piece_id=ILRUZZIPZUMAGZ7PNN3C633DZCCCEN5QPDW5HQM3QSHAUWOUA7OQ, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.969302145 (250h59m29.700569795s) [noise=true , address=79.127.219.51:4200 , piece_id=BZCK6L37XJIO57T3MPLMYTZCBBDIDG67BAOAP7ETSXPETYTKITYA, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.969322563 (250h59m29.700590213s) [noise=true , address=77.90.31.12:4596 , piece_id=MVMZI4BOJ4PWU7BRNYA7D4YCT37YABSG6OETHPKTYAX4TMSQUZQQ, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.969801784 (250h59m29.701069434s) [noise=true , address=104.36.82.23:4455 , piece_id=YE4H5NFXLN54J67PVV5G5PIQAB75GUZFL7ZXT3B4MJMYFQGOLS2Q, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.970257470 (250h59m29.701525121s) [noise=true , address=104.36.82.8:4993 , piece_id=43WF5V32QZDLLSBWLGD3HZBUM5FRLRN564QOQML6URJBWMEKBD2Q, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.970585927 (250h59m29.701853588s) [noise=true , address=77.90.31.18:4831 , piece_id=IXJ5OE6XVZFUDBIKCBNFX4T76RRTN4VZN4UVNEQ23Y2A4SAMBLZQ, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.971141402 (250h59m29.702409052s) [noise=true , address=77.90.31.17:4774 , piece_id=E473T3VIYSMEBVWXDAECMCVKU7C6JHLKI3QUXAGGNDN6OW45UKQQ, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.971212435 (250h59m29.702480086s) [noise=true , address=77.90.31.16:4752 , piece_id=DREK2KPZAX3LFY2M42WTAECJDWQ7KS5ZHAXRKY2HGUL2I5LMI3PQ, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.971629620 (250h59m29.70289728s) [noise=true , address=79.127.201.215:4347 , piece_id=KSY6M4LRSF4NP5MI7QQRWKBOWKISNDSYELJOE55ROU6YMY66HHIA, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.972181678 (250h59m29.703449328s) [noise=true , address=104.36.82.44:4884 , piece_id=I2KJNSUL42O72GG5YQCWTDT5YO6SERLGCE3KDMN3TXJ4VFTGVUDQ, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.974019824 (250h59m29.705287474s) [noise=true , address=104.36.82.10:4107 , piece_id=TIHDD5MINTI4EMC7DOYYVLCPMVTSNDFEPWCIBUF44GMDVPTVOSZA, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.974939503 (250h59m29.706207152s) [noise=true , address=77.90.31.14:4670 , piece_id=BOKOHH3DA5Q2U7IQC6FRKWU46ZGE5PQCZQZL76Y5B62XAUWQUHVA, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.976242623 (250h59m29.707510282s) [noise=true , address=66.23.193.175:4553 , piece_id=276F3J7GG4FDAHAQXYQS7XPFIO64IE7XW7BK4E364N6ZXYH4QFOQ, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.977127166 (250h59m29.708394816s) [noise=true , address=79.127.219.38:4023 , piece_id=6SDHQDVUZZFJ6BLAJJPKVB7ZDHWIUI5KIDBEFLNRJQ2SWFDRKTGA, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.980292527 (250h59m29.711560177s) [noise=true , address=77.90.31.10:4546 , piece_id=ATRZVDEQFVUCAX6MFFZSOL4ZUQOLLKQIKPM5K6FD7YOLROPPLWUQ, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.980765867 (250h59m29.712033517s) [noise=true , address=104.36.82.45:4915 , piece_id=3CW5USIA4BNGV5VH23MOXK5UHZ2VT6AUVD4SO3MQGZHXNRBORBNA, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:48.981453269 (250h59m29.71272093s) [noise=true , address=45.91.116.9:4280 , piece_id=TIOWQF6FGS6STHFNZDDGEKQPSKPID3J4CVGPVDGUBMGZILGNWEXA, seg_pos={0 0}, upload=261074]: Uploading piece... Aug 19 04:25:49.097528779 (250h59m29.828796429s) [upload=261074]: Next returned nil segment Aug 19 04:25:49.097561651 (250h59m29.828829301s) [upload=261074]: Waiting for error group managing segments... Aug 19 04:25:49.106821410 (250h59m29.83808906s) [noise=true , address=79.127.219.51:4200 , piece_id=BZCK6L37XJIO57T3MPLMYTZCBBDIDG67BAOAP7ETSXPETYTKITYA, seg_pos={0 0}, upload=261074]: Done uploading piece. err: <nil> Aug 19 04:25:49.109147573 (250h59m29.840415233s) [noise=true , address=79.127.219.38:4023 , piece_id=6SDHQDVUZZFJ6BLAJJPKVB7ZDHWIUI5KIDBEFLNRJQ2SWFDRKTGA, seg_pos={0 0}, upload=261074]: Done uploading piece. err: <nil> Aug 19 04:25:49.249385100 (250h59m29.98065275s) [noise=true , address=79.127.201.215:4347 , piece_id=KSY6M4LRSF4NP5MI7QQRWKBOWKISNDSYELJOE55ROU6YMY66HHIA, seg_pos={0 0}, upload=261074]: Done uploading piece. err: <nil> Aug 19 04:25:49.582474912 (250h59m30.313742562s) [noise=true , address=66.23.193.175:4553 , piece_id=276F3J7GG4FDAHAQXYQS7XPFIO64IE7XW7BK4E364N6ZXYH4QFOQ, seg_pos={0 0}, upload=261074]: Done uploading piece. err: <nil> Aug 19 04:26:48.920998040 (251h0m29.65226567s) [noise=true , address=77.90.31.10:4546 , piece_id=ATRZVDEQFVUCAX6MFFZSOL4ZUQOLLKQIKPM5K6FD7YOLROPPLWUQ, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:1jjRZPZ6TDPepFAmvv81dREkDJDrXqeu9wqzNYkeaGemFFdxwK, address:77.90.31.10:4546): protocol: rpc: dial tcp 77.90.31.10:4546: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921024009 (251h0m29.652291639s) [noise=true , address=77.90.31.14:4670 , piece_id=BOKOHH3DA5Q2U7IQC6FRKWU46ZGE5PQCZQZL76Y5B62XAUWQUHVA, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:12LQ2JYC2GB67iqFPW69DyASSKH9yN558jGYBFd2cRN8abegiTE, address:77.90.31.14:4670): protocol: rpc: dial tcp 77.90.31.14:4670: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921041512 (251h0m29.652309142s) [noise=true , address=77.90.31.12:4596 , piece_id=MVMZI4BOJ4PWU7BRNYA7D4YCT37YABSG6OETHPKTYAX4TMSQUZQQ, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: rpc: dial tcp 77.90.31.12:4596: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921062581 (251h0m29.652330211s) [noise=true , address=104.36.82.44:4884 , piece_id=I2KJNSUL42O72GG5YQCWTDT5YO6SERLGCE3KDMN3TXJ4VFTGVUDQ, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:1qGXdnm83P4eMnCtZdRt2x5yAWP7pQafWwoPG72daZJVR9pyKG, address:104.36.82.44:4884): protocol: rpc: dial tcp 104.36.82.44:4884: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921082048 (251h0m29.652349678s) [noise=true , address=104.36.82.23:4455 , piece_id=YE4H5NFXLN54J67PVV5G5PIQAB75GUZFL7ZXT3B4MJMYFQGOLS2Q, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:1wsyjF5X3iPrJsezUjakUArxc8K88T36yT4rE3yu6q9BMKfycm, address:104.36.82.23:4455): protocol: rpc: dial tcp 104.36.82.23:4455: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921091726 (251h0m29.652359356s) [noise=true , address=77.90.31.19:4849 , piece_id=C5VJ53C4ZNR5GXITLCGL66GCRQETUWQ5HMZ4NPRHGEYWD2A3CBIA, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:12F8hBt2nRQBHGzba5pPKyYJF37b7gRUnmBoZfDAYZAkYaUfk2V, address:77.90.31.19:4849): protocol: rpc: dial tcp 77.90.31.19:4849: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921111523 (251h0m29.652379143s) [noise=true , address=77.90.31.16:4752 , piece_id=DREK2KPZAX3LFY2M42WTAECJDWQ7KS5ZHAXRKY2HGUL2I5LMI3PQ, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:12iLnZ6bvgFWKtP79m7pa6rmStrpMGJQeUuDV3kTHQdFZQAWS4, address:77.90.31.16:4752): protocol: rpc: dial tcp 77.90.31.16:4752: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921119298 (251h0m29.652386917s) [noise=true , address=104.36.82.8:4993 , piece_id=43WF5V32QZDLLSBWLGD3HZBUM5FRLRN564QOQML6URJBWMEKBD2Q, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD, address:104.36.82.8:4993): protocol: rpc: dial tcp 104.36.82.8:4993: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921140267 (251h0m29.652407887s) [noise=true , address=45.91.116.9:4280 , piece_id=TIOWQF6FGS6STHFNZDDGEKQPSKPID3J4CVGPVDGUBMGZILGNWEXA, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:12ptydBd7T89noaveRPbmziYKKX9C1eNKaYG8BEfz2Zk4T9XtKz, address:45.91.116.9:4280): protocol: rpc: dial tcp 45.91.116.9:4280: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921146208 (251h0m29.652413838s) [noise=true , address=77.90.31.18:4831 , piece_id=IXJ5OE6XVZFUDBIKCBNFX4T76RRTN4VZN4UVNEQ23Y2A4SAMBLZQ, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA, address:77.90.31.18:4831): protocol: rpc: dial tcp 77.90.31.18:4831: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921171235 (251h0m29.652438865s) [noise=true , address=104.36.82.49:4012 , piece_id=ILRUZZIPZUMAGZ7PNN3C633DZCCCEN5QPDW5HQM3QSHAUWOUA7OQ, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:12ZS5nRRvwoF6T7AHt5Z83Z4r1eyzjMQo5yt9keVUa1UE3DR1W2, address:104.36.82.49:4012): protocol: rpc: dial tcp 104.36.82.49:4012: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921198867 (251h0m29.652466487s) [noise=true , address=104.36.82.10:4107 , piece_id=TIHDD5MINTI4EMC7DOYYVLCPMVTSNDFEPWCIBUF44GMDVPTVOSZA, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:1UeLnfo3bu6nCXkQDATe2yNhQEn6kZXicg6CFU9mGB37c1QJk4, address:104.36.82.10:4107): protocol: write tcp 5.161.89.252:61668->104.36.82.10:4107: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921203356 (251h0m29.652470976s) [noise=true , address=77.90.31.17:4774 , piece_id=E473T3VIYSMEBVWXDAECMCVKU7C6JHLKI3QUXAGGNDN6OW45UKQQ, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:12mZTv2q5zT1Za4DTcdFbUwWs1897vv9GXuLqPcnY3FaxTdGv3Y, address:77.90.31.17:4774): protocol: write tcp 5.161.89.252:14180->77.90.31.17:4774: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921219256 (251h0m29.652486876s) [noise=true , address=104.36.82.45:4915 , piece_id=3CW5USIA4BNGV5VH23MOXK5UHZ2VT6AUVD4SO3MQGZHXNRBORBNA, seg_pos={0 0}, upload=261074]: Done uploading piece. err: ecclient: upload failed (node:17rmsv4edxH6jmsN83ceiVJdfEui1qrBK5XBcf7GgvKCn2fknT, address:104.36.82.45:4915): protocol: rpc: dial tcp 104.36.82.45:4915: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:48.921231229 (251h0m29.652498859s) [seg_pos={0 0}, upload=261074]: Done waiting for segment. successful: 4 optimal: 14 errs: <nil> Aug 19 04:26:48.935095935 (251h0m29.666363565s) [upload=261074]: Done uploading segments... Aug 19 04:26:48.935106565 (251h0m29.666374195s) [upload=261074]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 4) Duration: 1m0.015195109s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 346.307792ms FAIL (2025-08-19 04:26:46 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 346.33321ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 184.820055ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-19 04:26:45 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 184.837498ms edge gateway vhost bgp us1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 962.210592ms FAIL (2025-08-19 04:26:45 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 962.227083ms edge authservice http bgp ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.43596402s FAIL (2025-08-19 04:26:44 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 1.435978527s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 162.686039ms FAIL (2025-08-19 04:26:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 162.703032ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 44.384524ms FAIL (2025-08-19 04:26:22 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 44.406896ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites) antiblip: 1 out of 15 is failed (threshold=6) [............X..] duration: 36.988371ms target: https://static.storj.io/dcs-satellites FAIL (2025-08-19 04:26:17 UTC) orbiter warning: Get "https://static.storj.io/dcs-satellites": dial tcp 34.120.119.150:443: i/o timeout Duration: 37.001315ms core website
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 691.810783ms target: https://ap1.storj.io/login FAIL (2025-08-19 04:26:16 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout Duration: 691.835078ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 30.017988913s FAIL (2025-08-19 04:26:15 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== N7USYH7LN6GA, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.871251803 (250h59m26.602519424s) [noise=true , address=45.91.116.5:4297 , piece_id=SVANCCUXVGUEKNVITHMBX7IJMM2GCO7KUA4ZVT6GZPOLHIGVUMQA, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.871495542 (250h59m26.602763172s) [noise=true , address=45.91.116.13:4154 , piece_id=J7CN7UHTANKS4ZUS5ZIQ67AVBODPNWO6PGWGQTCQLPNRB3HOWOLQ, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.871516270 (250h59m26.602783921s) [noise=true , address=104.36.82.16:4293 , piece_id=HDXZUB2CTNRGIZMIEAAJOPVUYTYHDCFVSMVWT5SCC5IH4RU2XB4Q, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.871742927 (250h59m26.603010558s) [noise=true , address=77.90.31.11:4553 , piece_id=A6SEQDAUZY5QGZ7UNTIPWRRQQIVSHVSD27ZBKXLRMGTH233VXUNA, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.872030588 (250h59m26.603298208s) [noise=true , address=45.91.116.9:4261 , piece_id=QTZBE3XA4EIMEM3RCGKYBIDLWSSOKKMSI2HCCVAZUAWC5X6IISCQ, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.872265700 (250h59m26.60353333s) [noise=true , address=77.90.31.17:4770 , piece_id=5BDT73QU52MIDDASFXEILL3HPCLG3YNHQMBAXISJ465QGQN2LS4Q, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.872335671 (250h59m26.603603321s) [noise=true , address=45.91.116.4:4937 , piece_id=XVY5X4PYQ7S2DJADRBO3CRLWRSR2OWDCI2TUBLJMYWSFMXGCH2BA, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.872600980 (250h59m26.60386861s) [noise=true , address=77.90.31.19:4841 , piece_id=JA47T3IEO2EGX34KL3CGFCPPYEXS4CROHOWGN4QJ3KTXEFYO2GGA, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.872999470 (250h59m26.604267119s) [noise=true , address=45.91.116.12:4227 , piece_id=WK7WA5XBRO4YQBIRKKE5QSMHNJ3AQT7KPITMJ4GUCOHKSUVYEPXQ, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.873812889 (250h59m26.605080549s) [noise=true , address=45.91.116.11:4117 , piece_id=6QZAIMQYT22IRDDIL6V4VZCJCBZ4DYLSYJ6V2GONJ7CQLH56WAYA, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.874576774 (250h59m26.605844425s) [noise=true , address=45.91.116.8:4045 , piece_id=UJSRXS6AFX5ILJQDFQ6XPGTAYR24CBWOXAYAYDKDWDU26I7I27QA, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:25:45.875568960 (250h59m26.606836611s) [noise=true , address=104.36.82.3:4765 , piece_id=O5FC2NM4AII2I64J4MWT6YG7TSWLYHWGZJC3B3YP6HTOYKLXBB4A, seg_pos={0 0}, upload=261071]: Uploading piece... Aug 19 04:26:15.834282974 (250h59m56.565550705s) [upload=261071]: Next segment err: context deadline exceeded Aug 19 04:26:15.835355461 (250h59m56.566623112s) [noise=true , address=77.90.31.15:4698 , piece_id=FTWQV4LZN4Y3XBLG7F34P3OXADDXV6VPDKS4TZR5LVPYGJJZJJ5A, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835419682 (250h59m56.566687342s) [noise=true , address=104.36.82.6:4876 , piece_id=VW2552MOYNLJRSDR7YOEWXHVQWBHDII76EYASXA7N7USYH7LN6GA, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: rpc: dial tcp 104.36.82.6:4876: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835471740 (250h59m56.566739389s) [noise=true , address=45.91.116.8:4045 , piece_id=UJSRXS6AFX5ILJQDFQ6XPGTAYR24CBWOXAYAYDKDWDU26I7I27QA, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: rpc: dial tcp 45.91.116.8:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835517586 (250h59m56.566785235s) [noise=true , address=45.91.116.7:4010 , piece_id=5UK3YYUPD2QOVA74GNZ2Y4XPBF6W356E75UPJX6HJ476X3AQ3LQA, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835561669 (250h59m56.566829319s) [noise=true , address=45.91.116.5:4297 , piece_id=SVANCCUXVGUEKNVITHMBX7IJMM2GCO7KUA4ZVT6GZPOLHIGVUMQA, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835608036 (250h59m56.566875696s) [noise=true , address=77.90.31.17:4770 , piece_id=5BDT73QU52MIDDASFXEILL3HPCLG3YNHQMBAXISJ465QGQN2LS4Q, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:22856->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835653121 (250h59m56.566920771s) [noise=true , address=45.91.116.4:4937 , piece_id=XVY5X4PYQ7S2DJADRBO3CRLWRSR2OWDCI2TUBLJMYWSFMXGCH2BA, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: rpc: dial tcp 45.91.116.4:4937: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835686844 (250h59m56.566954494s) [noise=true , address=45.91.116.12:4227 , piece_id=WK7WA5XBRO4YQBIRKKE5QSMHNJ3AQT7KPITMJ4GUCOHKSUVYEPXQ, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: rpc: dial tcp 45.91.116.12:4227: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835697273 (250h59m56.566964924s) [noise=true , address=45.91.116.9:4261 , piece_id=QTZBE3XA4EIMEM3RCGKYBIDLWSSOKKMSI2HCCVAZUAWC5X6IISCQ, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: rpc: dial tcp 45.91.116.9:4261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835747499 (250h59m56.567015149s) [noise=true , address=104.36.82.3:4765 , piece_id=O5FC2NM4AII2I64J4MWT6YG7TSWLYHWGZJC3B3YP6HTOYKLXBB4A, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:1b1zhuhfXoTexYZUxKUAdCNhWJD8oGC17uXKRykA3gErEEMPWV, address:104.36.82.3:4765): protocol: write tcp 5.161.89.252:26836->104.36.82.3:4765: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835755824 (250h59m56.567023474s) [noise=true , address=45.91.116.11:4117 , piece_id=6QZAIMQYT22IRDDIL6V4VZCJCBZ4DYLSYJ6V2GONJ7CQLH56WAYA, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: rpc: dial tcp 45.91.116.11:4117: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835788145 (250h59m56.567055795s) [noise=true , address=77.90.31.11:4553 , piece_id=A6SEQDAUZY5QGZ7UNTIPWRRQQIVSHVSD27ZBKXLRMGTH233VXUNA, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: rpc: dial tcp 77.90.31.11:4553: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835803564 (250h59m56.567071214s) [noise=true , address=77.90.31.19:4841 , piece_id=JA47T3IEO2EGX34KL3CGFCPPYEXS4CROHOWGN4QJ3KTXEFYO2GGA, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835816127 (250h59m56.567083778s) [noise=true , address=45.91.116.13:4154 , piece_id=J7CN7UHTANKS4ZUS5ZIQ67AVBODPNWO6PGWGQTCQLPNRB3HOWOLQ, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: rpc: dial tcp 45.91.116.13:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835855501 (250h59m56.567123151s) [noise=true , address=104.36.82.12:4150 , piece_id=4YPBDLKPIPK3OBLOOIMTNARJLRS23F7KFTWA5L5VJIR6GWMXEQDA, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: write tcp 5.161.89.252:56182->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835863687 (250h59m56.567131336s) [noise=true , address=104.36.82.16:4293 , piece_id=HDXZUB2CTNRGIZMIEAAJOPVUYTYHDCFVSMVWT5SCC5IH4RU2XB4Q, seg_pos={0 0}, upload=261071]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: rpc: dial tcp 104.36.82.16:4293: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:26:15.835878965 (250h59m56.567146615s) [seg_pos={0 0}, upload=261071]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 30.018003101s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.718717318s FAIL (2025-08-19 04:26:15 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 1.718737867s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://static.storj.io/dcs-satellites", ExpectedContent: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S"} failure (antiblip window 6/15): (http.dcs_satellites)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)