Orbiter History

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 682.967783ms target: https://ap1.storj.io/login FAIL (2025-08-19 04:40:48 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout Duration: 682.984334ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......................................XXXX.................] duration: 1.207798231s FAIL (2025-08-19 04:40:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 7) ======LOGS====== g piece... Aug 19 04:28:13.563886368 (251h1m54.295154018s) [noise=true , address=104.36.82.5:4843 , piece_id=Q3SLO2FDTYYYYOQZARVS3SHAPM5J3GCLNFQ355QAV7U5MWKMZQQA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.564531581 (251h1m54.295799231s) [noise=true , address=45.91.116.7:4037 , piece_id=B42RTCUIHRS5OUFJ5S5E6QWRKEN5H34IMBURUUSSUL53Y2FUYKZQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.564716169 (251h1m54.295983828s) [noise=true , address=104.36.82.15:4289 , piece_id=GVBKZHWTPFDGYCM6U5EUYLBOTGCTTLPDWW2WZKZZEVNG4UZ3XEYA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.565358756 (251h1m54.296626407s) [noise=true , address=77.90.31.21:4891 , piece_id=G57I4V2AOHDBI77GIIULZXTGCFC2BP6CQRX25KA7UNNIJ3WTAGPQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.565475757 (251h1m54.296743417s) [noise=true , address=45.91.116.9:4286 , piece_id=KUMIYTCCEU7XS2NMUTPXDSD7TMNASOBWGNWNDD7L6DMEAPXVIFWA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.566262315 (251h1m54.297529975s) [noise=true , address=104.36.82.44:4880 , piece_id=ZRDRV5AWRCYSUZJANVESK3XUCMLQQXF33WPV6QPX6HAZBYHXOUUQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.566506594 (251h1m54.297774285s) [noise=true , address=45.91.116.12:4243 , piece_id=GNLESUJ3FCKKUC7HOR7Z532H7LQT6ZOTOKLBGRN2R6UCJL4S3VFQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.567576856 (251h1m54.298844507s) [noise=true , address=45.91.116.4:4952 , piece_id=ZXPM75JCQGD3XQ3BTIP4O6SOLR6XCFNBUYQKKD56RTFVCMEGFWDQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.575982240 (251h1m54.30724989s) [noise=true , address=77.90.31.19:4862 , piece_id=7CQOCX2FYKPQCTCBFMN7BMTD3FE2D2X4YIHFLCL22AOSYLKUO33A, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.576556950 (251h1m54.3078246s) [noise=true , address=77.90.31.17:4801 , piece_id=A4D6GQYALBOB46EE7D2KI6422NES4M43E4DTX4CKBLNNP2VHZUJQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.577052442 (251h1m54.308320102s) [noise=true , address=104.36.82.13:4204 , piece_id=LWFS4W2N7K6SWYKXYHZRJACAYYDBIB7OGVETZWKVTWWWJBZPS33A, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.577571397 (251h1m54.308839058s) [noise=true , address=104.36.82.12:4156 , piece_id=RMBTQYXVS5NKE2ON3WW5T2CBE6S7S6T74VVVLMUSM5C44UXGRAYA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.581420654 (251h1m54.312688304s) [noise=true , address=77.90.31.12:4596 , piece_id=AEOFPZ64F5FUTWHLMKFVKQGNGYJYOIU7OZPLYGS7ULR52F5XSNYQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.582252959 (251h1m54.313520609s) [noise=true , address=77.90.31.18:4835 , piece_id=W6FEWYN4QCZC5IQFUG2YXSGKHSKKFRGETXK76LFKAVACLA37H7PA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.672688665 (251h1m54.403956365s) [upload=261114]: Next returned nil segment Aug 19 04:28:13.672710426 (251h1m54.403978086s) [upload=261114]: Waiting for error group managing segments... Aug 19 04:28:13.681638350 (251h1m54.412906s) [noise=true , address=79.127.219.48:4085 , piece_id=AT2YETVN3DCMAPBL45XWQQCTW5FR6JC4PWN3CRIMZPQW5OG3RKKQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:28.955286140 (251h2m9.68655377s) [noise=true , address=77.90.31.12:4596 , piece_id=AEOFPZ64F5FUTWHLMKFVKQGNGYJYOIU7OZPLYGS7ULR52F5XSNYQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: rpc: dial tcp 77.90.31.12:4596: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:45.285087265 (251h2m26.016354885s) [noise=true , address=104.36.82.60:4354 , piece_id=76HWEIKV5672IF34IRITARBMKGTN7OJU6GHQZZCDAP2ZUR2JNJFA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.286367592 (251h2m26.017635222s) [noise=true , address=104.36.82.13:4204 , piece_id=LWFS4W2N7K6SWYKXYHZRJACAYYDBIB7OGVETZWKVTWWWJBZPS33A, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.286429859 (251h2m26.017697489s) [noise=true , address=104.36.82.12:4156 , piece_id=RMBTQYXVS5NKE2ON3WW5T2CBE6S7S6T74VVVLMUSM5C44UXGRAYA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.288231957 (251h2m26.019499578s) [noise=true , address=104.36.82.15:4289 , piece_id=GVBKZHWTPFDGYCM6U5EUYLBOTGCTTLPDWW2WZKZZEVNG4UZ3XEYA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.316902561 (251h2m26.048170191s) [noise=true , address=104.36.82.44:4880 , piece_id=ZRDRV5AWRCYSUZJANVESK3XUCMLQQXF33WPV6QPX6HAZBYHXOUUQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:46.178003461 (251h2m26.90927112s) [noise=true , address=104.36.82.5:4843 , piece_id=Q3SLO2FDTYYYYOQZARVS3SHAPM5J3GCLNFQ355QAV7U5MWKMZQQA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:29:13.506175578 (251h2m54.237443199s) [noise=true , address=45.91.116.6:4988 , piece_id=X36K53BYKX53WMZKQWN2FFKCKTHNLIY3KLLPXMQN2UBKZM2CTT6Q, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1TrcoCHhAJeEykP9hJNpygoPSdgFV5v6GzL48JpyNPiAj5ZJRS, address:45.91.116.6:4988): protocol: rpc: dial tcp 45.91.116.6:4988: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506222607 (251h2m54.237490227s) [noise=true , address=45.91.116.9:4286 , piece_id=KUMIYTCCEU7XS2NMUTPXDSD7TMNASOBWGNWNDD7L6DMEAPXVIFWA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:19DfbHig9tzF4VRHtSWkExwUS2bdZ8GFgKnAD9wvMBG7qaesNa, address:45.91.116.9:4286): protocol: rpc: dial tcp 45.91.116.9:4286: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506254087 (251h2m54.237521717s) [noise=true , address=45.91.116.12:4243 , piece_id=GNLESUJ3FCKKUC7HOR7Z532H7LQT6ZOTOKLBGRN2R6UCJL4S3VFQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1e9VEMmhYq6PxqvTpxsoUHzqYVwujfj1UG7HSZFeiu8CderMpM, address:45.91.116.12:4243): protocol: rpc: dial tcp 45.91.116.12:4243: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506625304 (251h2m54.237892934s) [noise=true , address=77.90.31.21:4891 , piece_id=G57I4V2AOHDBI77GIIULZXTGCFC2BP6CQRX25KA7UNNIJ3WTAGPQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:17RDAerfx8AW5NsgWLTXLNDbuAEWQFT3SVM4iwdmuBzWrML83g, address:77.90.31.21:4891): protocol: rpc: dial tcp 77.90.31.21:4891: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506656563 (251h2m54.237924213s) [noise=true , address=77.90.31.19:4862 , piece_id=7CQOCX2FYKPQCTCBFMN7BMTD3FE2D2X4YIHFLCL22AOSYLKUO33A, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1Tvmo3nSgBPcFYW9MmZQGUeMoD3m3ykJHwVMj6tj69iQKgX3Mz, address:77.90.31.19:4862): protocol: rpc: dial tcp 77.90.31.19:4862: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Aug 19 04:29:13.506689415 (251h2m54.237957045s) [noise=true , address=77.90.31.18:4835 , piece_id=W6FEWYN4QCZC5IQFUG2YXSGKHSKKFRGETXK76LFKAVACLA37H7PA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:12hAQp2Zr7WSaQSTCZf5pwSyuBHHSrZWq5EVz5hFvSA5ddWebqg, address:77.90.31.18:4835): protocol: write tcp 5.161.89.252:27410->77.90.31.18:4835: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506740311 (251h2m54.23800793s) [noise=true , address=45.91.116.7:4037 , piece_id=B42RTCUIHRS5OUFJ5S5E6QWRKEN5H34IMBURUUSSUL53Y2FUYKZQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: rpc: dial tcp 45.91.116.7:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506774885 (251h2m54.238042535s) [noise=true , address=77.90.31.17:4801 , piece_id=A4D6GQYALBOB46EE7D2KI6422NES4M43E4DTX4CKBLNNP2VHZUJQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe, address:77.90.31.17:4801): protocol: write tcp 5.161.89.252:48394->77.90.31.17:4801: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506808788 (251h2m54.238076419s) [noise=true , address=45.91.116.4:4952 , piece_id=ZXPM75JCQGD3XQ3BTIP4O6SOLR6XCFNBUYQKKD56RTFVCMEGFWDQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1PcGuaN6uLz1HVzMgBp4vViKJw2KrmaFatL1w9DHgiYqccMUJ9, address:45.91.116.4:4952): protocol: write tcp 5.161.89.252:61300->45.91.116.4:4952: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506825761 (251h2m54.23809341s) [noise=true , address=77.90.31.13:4645 , piece_id=TGFZGBBRZLA32ZJS3BGT7OSHJW4S34PWMYSQKCZT4RG2IUTGPZSQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: rpc: dial tcp 77.90.31.13:4645: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506906624 (251h2m54.238174313s) [seg_pos={0 0}, upload=261114]: Done waiting for segment. successful: 7 optimal: 14 errs: <nil> Aug 19 04:29:13.523807608 (251h2m54.255075238s) [upload=261114]: Done uploading segments... Aug 19 04:29:13.523824049 (251h2m54.255091679s) [upload=261114]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 7) Duration: 1.20782466s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 203.250854ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-08-19 04:40:47 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 203.273567ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.782581657s FAIL (2025-08-19 04:40:40 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 1.782728674s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 4.69280144s FAIL (2025-08-19 04:40:37 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.692830705s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 180.937728ms FAIL (2025-08-19 04:40:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 180.953748ms edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 930.487602ms FAIL (2025-08-19 04:40:33 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 930.512819ms core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 691.690154ms FAIL (2025-08-19 04:40:30 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 691.710981ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.209685321s FAIL (2025-08-19 04:40:29 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 1.209718542s edge authservice http bgp ap1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 582.86592ms FAIL (2025-08-19 04:40:28 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 582.912869ms edge authservice http bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................XXXX................] duration: 1.60550672s FAIL (2025-08-19 04:40:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 2) ======LOGS====== Aug 19 04:27:49.109078986 (251h1m29.840346686s) [upload=261106]: Starting upload Aug 19 04:27:49.109176229 (251h1m29.84044389s) [upload=261106]: Done starting upload Aug 19 04:27:49.109275225 (251h1m29.840542885s) [upload=261106]: Uploading segments... Aug 19 04:27:49.109595368 (251h1m29.840863017s) [upload=261106]: Got next segment. Inline: false Aug 19 04:27:49.109658597 (251h1m29.840926246s) [upload=261106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:27:49.109666732 (251h1m29.840934381s) [upload=261106]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:27:49.134178766 (251h1m29.865446416s) [seg_pos={0 0}, upload=261106]: Begin upload segment... Aug 19 04:27:49.134254959 (251h1m29.865522609s) [seg_pos={0 0}, upload=261106]: Done begin upload segment. Aug 19 04:27:49.134289924 (251h1m29.865557575s) [noise=true , address=104.36.82.44:4880 , piece_id=OWN24XFAQIM7CMFWBVRK6PV4ERW3TBTNA7VIB2TYN27G3TBOPBRQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.134334910 (251h1m29.86560256s) [noise=true , address=79.127.201.215:4356 , piece_id=TILCDB2RMDIH7BJ4FW6WQQA2LM5BOWLAGNTLYAYIMKDYM2CMR67A, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.134795515 (251h1m29.866063155s) [noise=true , address=77.90.31.15:4718 , piece_id=SYYDCERFUSC7JVNEUCUSWTPHOCKPYH5HFEO6KQSVG3FI6JDLXLWQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135276820 (251h1m29.866544471s) [noise=true , address=45.91.116.14:4194 , piece_id=HZXGZJPTHDOYJAQWT4RVKJ752SKAYQS4O5RR5BEKLMQ4SIQJ2SHA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135483198 (251h1m29.866750918s) [noise=true , address=45.91.116.5:4331 , piece_id=DPOTJF7RFLT44ADTZPVH7VR3YUCPYAXEOUZDKERJV22SPSGROM7A, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135835029 (251h1m29.86710268s) [noise=true , address=66.23.193.175:4557 , piece_id=ZSROC6HZO7LIP4SI7SPJCBTRUGPSHB62EISHETVUTQMRJTQBSMTA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135982557 (251h1m29.867250207s) [noise=true , address=45.91.116.8:4068 , piece_id=AKGKSIWCFRFYZGFB22H2Q3FAG6XNNR7LBCMV3KULU4CFGAAQ2YYA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136339348 (251h1m29.867606998s) [noise=true , address=104.36.82.60:4364 , piece_id=LV2P23XGSL6F6KFF7HDI4Z5BCB7WYEFNVYOTHG4Q7A2ERIVCIOAQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136504377 (251h1m29.867772038s) [noise=true , address=45.91.116.13:4157 , piece_id=VVL7322GYRIASBHU36CMMX5G4VWLEG4O2L53RCSK7AG3Z6MZ45VA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136732658 (251h1m29.868000308s) [noise=true , address=45.91.116.7:4021 , piece_id=KDCRCAW6746D4XEY25R33PMTLB5XCNZHD26QXMRQ6D6CO67BMLWQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137048441 (251h1m29.868316111s) [noise=true , address=45.91.116.11:4131 , piece_id=W7QKRAXI7TA3PIU4ECH7GCPRTKGDZAMTRYYL6UJJ5GA7FGTA4JEA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137154821 (251h1m29.86842246s) [noise=true , address=45.91.116.9:4292 , piece_id=ADAI7NEMMI7ZNIB47HHPUGSZ6ZXDZ3Y62HX6IWODYSBJV6RPK5HQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137545365 (251h1m29.868813055s) [noise=true , address=77.90.31.17:4791 , piece_id=CR364E44HFK3FWRAN66ZTZBJACZRE4XQF55FYNEHDET3M2YIMQEA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137595189 (251h1m29.86886284s) [noise=true , address=77.90.31.18:4834 , piece_id=PBGC5NB37NOL3R5DXORQNDCOJTAXWGDMTVCZA6UGET3IBLK6C27Q, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.138058961 (251h1m29.869326611s) [noise=true , address=77.90.31.19:4848 , piece_id=F3KSQJIANH5VCAYYYUQVTTA4CMZGRRHKCQNURLQN3AYHKVDOGGXA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.138607101 (251h1m29.869874751s) [noise=true , address=104.36.82.2:4744 , piece_id=RRUKZCLUW2RZEYTZNCRUIACUQK5UQ5HSDYTC43VDE4KV6HZMTFTQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.139135725 (251h1m29.870403376s) [noise=true , address=104.36.82.5:4851 , piece_id=P5QD3QUIGQHWZL7ZADHRHTJ4R7MFQG3W5MAWSXTL4VWBJVY7AWQQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.145535768 (251h1m29.876803418s) [noise=true , address=104.36.82.8:4994 , piece_id=XE5CSSEZHBRSS42BSBUVZAMFTZQP5BOSNCILEPXCIZPEDFTQLPUA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.330351465 (251h1m30.061619115s) [upload=261106]: Next returned nil segment Aug 19 04:27:49.330371102 (251h1m30.061638752s) [upload=261106]: Waiting for error group managing segments... Aug 19 04:27:49.396836051 (251h1m30.128103681s) [noise=true , address=79.127.201.215:4356 , piece_id=TILCDB2RMDIH7BJ4FW6WQQA2LM5BOWLAGNTLYAYIMKDYM2CMR67A, seg_pos={0 0}, upload=261106]: Done uploading piece. err: <nil> Aug 19 04:27:49.722370750 (251h1m30.4536384s) [noise=true , address=66.23.193.175:4557 , piece_id=ZSROC6HZO7LIP4SI7SPJCBTRUGPSHB62EISHETVUTQMRJTQBSMTA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: <nil> Aug 19 04:28:49.088391363 (251h2m29.819658993s) [noise=true , address=45.91.116.13:4157 , piece_id=VVL7322GYRIASBHU36CMMX5G4VWLEG4O2L53RCSK7AG3Z6MZ45VA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj, address:45.91.116.13:4157): protocol: rpc: dial tcp 45.91.116.13:4157: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088478717 (251h2m29.819746348s) [noise=true , address=104.36.82.8:4994 , piece_id=XE5CSSEZHBRSS42BSBUVZAMFTZQP5BOSNCILEPXCIZPEDFTQLPUA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:13nneaPpsRT7mVEc6cDt7GiZSMTU68Nnk1rr9Lbn5ycZkmQGrB, address:104.36.82.8:4994): protocol: rpc: dial tcp 104.36.82.8:4994: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088549861 (251h2m29.819817491s) [noise=true , address=104.36.82.5:4851 , piece_id=P5QD3QUIGQHWZL7ZADHRHTJ4R7MFQG3W5MAWSXTL4VWBJVY7AWQQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R, address:104.36.82.5:4851): protocol: rpc: dial tcp 104.36.82.5:4851: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088642636 (251h2m29.819910266s) [noise=true , address=104.36.82.44:4880 , piece_id=OWN24XFAQIM7CMFWBVRK6PV4ERW3TBTNA7VIB2TYN27G3TBOPBRQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:104.36.82.44:4880): protocol: rpc: dial tcp 104.36.82.44:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088691026 (251h2m29.819958646s) [noise=true , address=77.90.31.15:4718 , piece_id=SYYDCERFUSC7JVNEUCUSWTPHOCKPYH5HFEO6KQSVG3FI6JDLXLWQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC, address:77.90.31.15:4718): protocol: write tcp 5.161.89.252:52356->77.90.31.15:4718: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088749125 (251h2m29.820016755s) [noise=true , address=45.91.116.8:4068 , piece_id=AKGKSIWCFRFYZGFB22H2Q3FAG6XNNR7LBCMV3KULU4CFGAAQ2YYA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1jN6HbQbPBjk645swQd33LrTfb3LbAWk1dPNXU45zFrgmm6Q82, address:45.91.116.8:4068): protocol: rpc: dial tcp 45.91.116.8:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088802316 (251h2m29.820069946s) [noise=true , address=104.36.82.60:4364 , piece_id=LV2P23XGSL6F6KFF7HDI4Z5BCB7WYEFNVYOTHG4Q7A2ERIVCIOAQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk, address:104.36.82.60:4364): protocol: rpc: dial tcp 104.36.82.60:4364: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088852240 (251h2m29.82011987s) [noise=true , address=77.90.31.17:4791 , piece_id=CR364E44HFK3FWRAN66ZTZBJACZRE4XQF55FYNEHDET3M2YIMQEA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM, address:77.90.31.17:4791): protocol: write tcp 5.161.89.252:21530->77.90.31.17:4791: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089043649 (251h2m29.82031127s) [noise=true , address=45.91.116.9:4292 , piece_id=ADAI7NEMMI7ZNIB47HHPUGSZ6ZXDZ3Y62HX6IWODYSBJV6RPK5HQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12tnWSKAebAwLeGWGRsNnYpcWgbX5UHSVRUnnu9qesUZCK4vY81, address:45.91.116.9:4292): protocol: rpc: dial tcp 45.91.116.9:4292: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089121746 (251h2m29.820389376s) [noise=true , address=77.90.31.18:4834 , piece_id=PBGC5NB37NOL3R5DXORQNDCOJTAXWGDMTVCZA6UGET3IBLK6C27Q, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q, address:77.90.31.18:4834): protocol: rpc: dial tcp 77.90.31.18:4834: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089195093 (251h2m29.820462723s) [noise=true , address=77.90.31.19:4848 , piece_id=F3KSQJIANH5VCAYYYUQVTTA4CMZGRRHKCQNURLQN3AYHKVDOGGXA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD, address:77.90.31.19:4848): protocol: write tcp 5.161.89.252:19210->77.90.31.19:4848: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089270406 (251h2m29.820538036s) [noise=true , address=104.36.82.2:4744 , piece_id=RRUKZCLUW2RZEYTZNCRUIACUQK5UQ5HSDYTC43VDE4KV6HZMTFTQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12A6abQMwnX4PhLYTvkGLinPx4eNeVyS15SGzWiLUq4cwKQ6bmH, address:104.36.82.2:4744): protocol: rpc: dial tcp 104.36.82.2:4744: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089308247 (251h2m29.820575877s) [noise=true , address=45.91.116.5:4331 , piece_id=DPOTJF7RFLT44ADTZPVH7VR3YUCPYAXEOUZDKERJV22SPSGROM7A, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: rpc: dial tcp 45.91.116.5:4331: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089356988 (251h2m29.820624608s) [noise=true , address=45.91.116.7:4021 , piece_id=KDCRCAW6746D4XEY25R33PMTLB5XCNZHD26QXMRQ6D6CO67BMLWQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1bXLNG7g5RJc21AjrfHup6LDTd2dDJGWMzrBhVYwUT7fNm8J2Z, address:45.91.116.7:4021): protocol: rpc: dial tcp 45.91.116.7:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089381043 (251h2m29.820648673s) [noise=true , address=45.91.116.14:4194 , piece_id=HZXGZJPTHDOYJAQWT4RVKJ752SKAYQS4O5RR5BEKLMQ4SIQJ2SHA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:19mdk9cXDR79ZXC4n6rMXFUhpwxMPXFpkPA14ymY24RK1jKkmd, address:45.91.116.14:4194): protocol: rpc: dial tcp 45.91.116.14:4194: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089392665 (251h2m29.820660295s) [noise=true , address=45.91.116.11:4131 , piece_id=W7QKRAXI7TA3PIU4ECH7GCPRTKGDZAMTRYYL6UJJ5GA7FGTA4JEA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:124sCe84Td2UTjNKjgjFhaHbkkcLgvZY3Hn2LnAYYrsx5c14rUE, address:45.91.116.11:4131): protocol: write tcp 5.161.89.252:59470->45.91.116.11:4131: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089421198 (251h2m29.820688829s) [seg_pos={0 0}, upload=261106]: Done waiting for segment. successful: 2 optimal: 14 errs: <nil> Aug 19 04:28:49.140905793 (251h2m29.872173413s) [upload=261106]: Done uploading segments... Aug 19 04:28:49.140920150 (251h2m29.87218777s) [upload=261106]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 2) Duration: 1.605531327s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 691.098038ms target: https://ap1.storj.io/login FAIL (2025-08-19 04:40:19 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout Duration: 691.116062ms core satellite ap1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 8.965344ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-19 04:40:18 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34965->127.0.0.1:53: i/o timeout Duration: 8.98986ms edge linksharing us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 321.325986ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-19 04:40:14 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 321.351002ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [.......................................XXXXXX...............] duration: 1.194455488s FAIL (2025-08-19 04:40:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== ad=261108]: Uploading piece... Aug 19 04:27:59.298715587 (251h1m40.029983236s) [noise=true , address=45.91.116.10:4081 , piece_id=VXW7T7RYDQYFA67EV4IP5EFMNLSPHO6YMYO4NCUBCDOSPQWID6KQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.298767684 (251h1m40.030035364s) [noise=true , address=45.91.116.11:4119 , piece_id=6NZDOUCLI5JRQ5XXZMNLBXIVXMHR7NJY6BTCMA22QMNC3ZJJFCMA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299257736 (251h1m40.030525387s) [noise=true , address=45.91.116.10:4083 , piece_id=N7ABFK4IGEFBUNEAQI3SFS7IC6SCOHQD4TN2QOWDUSNRM4ZLXV7A, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299339650 (251h1m40.030607301s) [noise=true , address=77.90.31.21:4878 , piece_id=X3FKRFUU6S3AB6ZPUNPB2HOGLJ5E7U4AWTEFH6PISRIBECP3GVSQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299714204 (251h1m40.030981855s) [noise=true , address=45.91.116.8:4045 , piece_id=OH3KNS4URAIN3T4FLAPSYC2SHQKOEBLJMF2AVG7MXJULLC3P7QYA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299820754 (251h1m40.031088415s) [noise=true , address=77.90.31.10:4517 , piece_id=QXH4JBJTSA4VLHPS2OUAR3XF7QEL3WSX2JJT7VTZMRBVWS3OIOQQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300136579 (251h1m40.031404229s) [noise=true , address=77.90.31.12:4592 , piece_id=25GKL2MHGGV6IC7JDU5MBJ4MOCCNPGMXQPYXH7A4FFFJ5EZGVZ2Q, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300491886 (251h1m40.031759547s) [noise=true , address=45.91.116.9:4261 , piece_id=RAEAWIKMHIV4VGOZY57ZK36BNZGZ2ATXTXC4YHRABT6VWB6MGILA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300854618 (251h1m40.032122269s) [noise=true , address=104.36.82.2:4732 , piece_id=WKRORDL2XPRF2KRKZ55EQ2PTPJHPJSQ6NQ4D3VVFK6COGG57KDNQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.301277543 (251h1m40.032545194s) [noise=true , address=45.91.116.14:4190 , piece_id=SGZNGKGYEKPU4GXCULPKYIOONZZXZT6UTO7MDWYOJRJJW4WSG3VA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.301655164 (251h1m40.032922814s) [noise=true , address=104.36.82.7:4910 , piece_id=R6GR56GOKT2K3AX75OL3BWODTZ4FJY27MIOQWFYJVY4UGR66DIBQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.302072699 (251h1m40.033340349s) [noise=true , address=104.36.82.16:4294 , piece_id=GT3KQOCWD2YTWBQDAO5QJKYIMZINUF4MESKP6F3P6J73R4IY3NDQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:28:02.354368898 (251h1m43.085636557s) [noise=true , address=77.90.31.21:4878 , piece_id=X3FKRFUU6S3AB6ZPUNPB2HOGLJ5E7U4AWTEFH6PISRIBECP3GVSQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 5.161.89.252:64042->77.90.31.21:4878: write: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:02.385567243 (251h1m43.116834893s) [noise=true , address=77.90.31.12:4592 , piece_id=25GKL2MHGGV6IC7JDU5MBJ4MOCCNPGMXQPYXH7A4FFFJ5EZGVZ2Q, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 5.161.89.252:34306->77.90.31.12:4592: write: no route to host; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Aug 19 04:28:29.225676153 (251h2m9.956943773s) [upload=261108]: Next segment err: context deadline exceeded Aug 19 04:28:29.225998790 (251h2m9.95726642s) [noise=true , address=104.36.82.2:4732 , piece_id=WKRORDL2XPRF2KRKZ55EQ2PTPJHPJSQ6NQ4D3VVFK6COGG57KDNQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: rpc: dial tcp 104.36.82.2:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226039707 (251h2m9.957307326s) [noise=true , address=45.91.116.11:4119 , piece_id=6NZDOUCLI5JRQ5XXZMNLBXIVXMHR7NJY6BTCMA22QMNC3ZJJFCMA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226072177 (251h2m9.957339798s) [noise=true , address=45.91.116.8:4045 , piece_id=OH3KNS4URAIN3T4FLAPSYC2SHQKOEBLJMF2AVG7MXJULLC3P7QYA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: rpc: dial tcp 45.91.116.8:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226223943 (251h2m9.957491573s) [noise=true , address=45.91.116.14:4190 , piece_id=SGZNGKGYEKPU4GXCULPKYIOONZZXZT6UTO7MDWYOJRJJW4WSG3VA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226274027 (251h2m9.957541647s) [noise=true , address=45.91.116.13:4154 , piece_id=WM56E23Z7FLRF33HYDXONXHODJDHPCJFWGVC3NI7RUTZUESWO4MQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: rpc: dial tcp 45.91.116.13:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226310786 (251h2m9.957578416s) [noise=true , address=77.90.31.17:4771 , piece_id=3BVZK3ZL7N5FC3OJGFFYTVEG7INVMLMG2QBPXX3UC3EJVXHBGW3Q, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: rpc: dial tcp 77.90.31.17:4771: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226348096 (251h2m9.957615726s) [noise=true , address=104.36.82.11:4114 , piece_id=P4RJRUZPRTFPRK5WWHKUVEKJKXGPPPCIV4RPFIZOBO2CPOXSTSIQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226392119 (251h2m9.957659749s) [noise=true , address=45.91.116.10:4081 , piece_id=VXW7T7RYDQYFA67EV4IP5EFMNLSPHO6YMYO4NCUBCDOSPQWID6KQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 5.161.89.252:44604->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226421564 (251h2m9.957689195s) [noise=true , address=45.91.116.9:4261 , piece_id=RAEAWIKMHIV4VGOZY57ZK36BNZGZ2ATXTXC4YHRABT6VWB6MGILA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: rpc: dial tcp 45.91.116.9:4261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226443746 (251h2m9.957711377s) [noise=true , address=45.91.116.4:4940 , piece_id=GYF7CH3463KOWU7DE7WKLYTXYXLTRMPOIK4K3D64ANKOERN33FGQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:53922->45.91.116.4:4940: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226474684 (251h2m9.957742315s) [noise=true , address=104.36.82.7:4910 , piece_id=R6GR56GOKT2K3AX75OL3BWODTZ4FJY27MIOQWFYJVY4UGR66DIBQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:104.36.82.7:4910): protocol: rpc: dial tcp 104.36.82.7:4910: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226493810 (251h2m9.95776143s) [noise=true , address=45.91.116.10:4083 , piece_id=N7ABFK4IGEFBUNEAQI3SFS7IC6SCOHQD4TN2QOWDUSNRM4ZLXV7A, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: rpc: dial tcp 45.91.116.10:4083: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226509199 (251h2m9.957776829s) [noise=true , address=104.36.82.16:4294 , piece_id=GT3KQOCWD2YTWBQDAO5QJKYIMZINUF4MESKP6F3P6J73R4IY3NDQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:104.36.82.16:4294): protocol: write tcp 5.161.89.252:25886->104.36.82.16:4294: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226527894 (251h2m9.957795524s) [noise=true , address=77.90.31.10:4517 , piece_id=QXH4JBJTSA4VLHPS2OUAR3XF7QEL3WSX2JJT7VTZMRBVWS3OIOQQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226544845 (251h2m9.957812476s) [seg_pos={0 0}, upload=261108]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 1.194479432s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.58801094s FAIL (2025-08-19 04:40:07 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 1.588028582s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 713.726687ms FAIL (2025-08-19 04:39:59 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 713.780027ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 171.979306ms FAIL (2025-08-19 04:39:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 171.999474ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 245.736052ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-19 04:39:56 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 245.760538ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 4.77114018s FAIL (2025-08-19 04:39:51 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.771162232s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [........................................XXXXXX..............] duration: 605.347152ms FAIL (2025-08-19 04:39:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== ad=261108]: Uploading piece... Aug 19 04:27:59.298715587 (251h1m40.029983236s) [noise=true , address=45.91.116.10:4081 , piece_id=VXW7T7RYDQYFA67EV4IP5EFMNLSPHO6YMYO4NCUBCDOSPQWID6KQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.298767684 (251h1m40.030035364s) [noise=true , address=45.91.116.11:4119 , piece_id=6NZDOUCLI5JRQ5XXZMNLBXIVXMHR7NJY6BTCMA22QMNC3ZJJFCMA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299257736 (251h1m40.030525387s) [noise=true , address=45.91.116.10:4083 , piece_id=N7ABFK4IGEFBUNEAQI3SFS7IC6SCOHQD4TN2QOWDUSNRM4ZLXV7A, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299339650 (251h1m40.030607301s) [noise=true , address=77.90.31.21:4878 , piece_id=X3FKRFUU6S3AB6ZPUNPB2HOGLJ5E7U4AWTEFH6PISRIBECP3GVSQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299714204 (251h1m40.030981855s) [noise=true , address=45.91.116.8:4045 , piece_id=OH3KNS4URAIN3T4FLAPSYC2SHQKOEBLJMF2AVG7MXJULLC3P7QYA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299820754 (251h1m40.031088415s) [noise=true , address=77.90.31.10:4517 , piece_id=QXH4JBJTSA4VLHPS2OUAR3XF7QEL3WSX2JJT7VTZMRBVWS3OIOQQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300136579 (251h1m40.031404229s) [noise=true , address=77.90.31.12:4592 , piece_id=25GKL2MHGGV6IC7JDU5MBJ4MOCCNPGMXQPYXH7A4FFFJ5EZGVZ2Q, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300491886 (251h1m40.031759547s) [noise=true , address=45.91.116.9:4261 , piece_id=RAEAWIKMHIV4VGOZY57ZK36BNZGZ2ATXTXC4YHRABT6VWB6MGILA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300854618 (251h1m40.032122269s) [noise=true , address=104.36.82.2:4732 , piece_id=WKRORDL2XPRF2KRKZ55EQ2PTPJHPJSQ6NQ4D3VVFK6COGG57KDNQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.301277543 (251h1m40.032545194s) [noise=true , address=45.91.116.14:4190 , piece_id=SGZNGKGYEKPU4GXCULPKYIOONZZXZT6UTO7MDWYOJRJJW4WSG3VA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.301655164 (251h1m40.032922814s) [noise=true , address=104.36.82.7:4910 , piece_id=R6GR56GOKT2K3AX75OL3BWODTZ4FJY27MIOQWFYJVY4UGR66DIBQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.302072699 (251h1m40.033340349s) [noise=true , address=104.36.82.16:4294 , piece_id=GT3KQOCWD2YTWBQDAO5QJKYIMZINUF4MESKP6F3P6J73R4IY3NDQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:28:02.354368898 (251h1m43.085636557s) [noise=true , address=77.90.31.21:4878 , piece_id=X3FKRFUU6S3AB6ZPUNPB2HOGLJ5E7U4AWTEFH6PISRIBECP3GVSQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 5.161.89.252:64042->77.90.31.21:4878: write: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:02.385567243 (251h1m43.116834893s) [noise=true , address=77.90.31.12:4592 , piece_id=25GKL2MHGGV6IC7JDU5MBJ4MOCCNPGMXQPYXH7A4FFFJ5EZGVZ2Q, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 5.161.89.252:34306->77.90.31.12:4592: write: no route to host; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Aug 19 04:28:29.225676153 (251h2m9.956943773s) [upload=261108]: Next segment err: context deadline exceeded Aug 19 04:28:29.225998790 (251h2m9.95726642s) [noise=true , address=104.36.82.2:4732 , piece_id=WKRORDL2XPRF2KRKZ55EQ2PTPJHPJSQ6NQ4D3VVFK6COGG57KDNQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: rpc: dial tcp 104.36.82.2:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226039707 (251h2m9.957307326s) [noise=true , address=45.91.116.11:4119 , piece_id=6NZDOUCLI5JRQ5XXZMNLBXIVXMHR7NJY6BTCMA22QMNC3ZJJFCMA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226072177 (251h2m9.957339798s) [noise=true , address=45.91.116.8:4045 , piece_id=OH3KNS4URAIN3T4FLAPSYC2SHQKOEBLJMF2AVG7MXJULLC3P7QYA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: rpc: dial tcp 45.91.116.8:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226223943 (251h2m9.957491573s) [noise=true , address=45.91.116.14:4190 , piece_id=SGZNGKGYEKPU4GXCULPKYIOONZZXZT6UTO7MDWYOJRJJW4WSG3VA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226274027 (251h2m9.957541647s) [noise=true , address=45.91.116.13:4154 , piece_id=WM56E23Z7FLRF33HYDXONXHODJDHPCJFWGVC3NI7RUTZUESWO4MQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: rpc: dial tcp 45.91.116.13:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226310786 (251h2m9.957578416s) [noise=true , address=77.90.31.17:4771 , piece_id=3BVZK3ZL7N5FC3OJGFFYTVEG7INVMLMG2QBPXX3UC3EJVXHBGW3Q, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: rpc: dial tcp 77.90.31.17:4771: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226348096 (251h2m9.957615726s) [noise=true , address=104.36.82.11:4114 , piece_id=P4RJRUZPRTFPRK5WWHKUVEKJKXGPPPCIV4RPFIZOBO2CPOXSTSIQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226392119 (251h2m9.957659749s) [noise=true , address=45.91.116.10:4081 , piece_id=VXW7T7RYDQYFA67EV4IP5EFMNLSPHO6YMYO4NCUBCDOSPQWID6KQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 5.161.89.252:44604->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226421564 (251h2m9.957689195s) [noise=true , address=45.91.116.9:4261 , piece_id=RAEAWIKMHIV4VGOZY57ZK36BNZGZ2ATXTXC4YHRABT6VWB6MGILA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: rpc: dial tcp 45.91.116.9:4261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226443746 (251h2m9.957711377s) [noise=true , address=45.91.116.4:4940 , piece_id=GYF7CH3463KOWU7DE7WKLYTXYXLTRMPOIK4K3D64ANKOERN33FGQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:53922->45.91.116.4:4940: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226474684 (251h2m9.957742315s) [noise=true , address=104.36.82.7:4910 , piece_id=R6GR56GOKT2K3AX75OL3BWODTZ4FJY27MIOQWFYJVY4UGR66DIBQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:104.36.82.7:4910): protocol: rpc: dial tcp 104.36.82.7:4910: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226493810 (251h2m9.95776143s) [noise=true , address=45.91.116.10:4083 , piece_id=N7ABFK4IGEFBUNEAQI3SFS7IC6SCOHQD4TN2QOWDUSNRM4ZLXV7A, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: rpc: dial tcp 45.91.116.10:4083: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226509199 (251h2m9.957776829s) [noise=true , address=104.36.82.16:4294 , piece_id=GT3KQOCWD2YTWBQDAO5QJKYIMZINUF4MESKP6F3P6J73R4IY3NDQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:104.36.82.16:4294): protocol: write tcp 5.161.89.252:25886->104.36.82.16:4294: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226527894 (251h2m9.957795524s) [noise=true , address=77.90.31.10:4517 , piece_id=QXH4JBJTSA4VLHPS2OUAR3XF7QEL3WSX2JJT7VTZMRBVWS3OIOQQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226544845 (251h2m9.957812476s) [seg_pos={0 0}, upload=261108]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 605.372129ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................................XXXX...............] duration: 625.051786ms FAIL (2025-08-19 04:39:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 2) ======LOGS====== Aug 19 04:27:49.109078986 (251h1m29.840346686s) [upload=261106]: Starting upload Aug 19 04:27:49.109176229 (251h1m29.84044389s) [upload=261106]: Done starting upload Aug 19 04:27:49.109275225 (251h1m29.840542885s) [upload=261106]: Uploading segments... Aug 19 04:27:49.109595368 (251h1m29.840863017s) [upload=261106]: Got next segment. Inline: false Aug 19 04:27:49.109658597 (251h1m29.840926246s) [upload=261106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:27:49.109666732 (251h1m29.840934381s) [upload=261106]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:27:49.134178766 (251h1m29.865446416s) [seg_pos={0 0}, upload=261106]: Begin upload segment... Aug 19 04:27:49.134254959 (251h1m29.865522609s) [seg_pos={0 0}, upload=261106]: Done begin upload segment. Aug 19 04:27:49.134289924 (251h1m29.865557575s) [noise=true , address=104.36.82.44:4880 , piece_id=OWN24XFAQIM7CMFWBVRK6PV4ERW3TBTNA7VIB2TYN27G3TBOPBRQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.134334910 (251h1m29.86560256s) [noise=true , address=79.127.201.215:4356 , piece_id=TILCDB2RMDIH7BJ4FW6WQQA2LM5BOWLAGNTLYAYIMKDYM2CMR67A, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.134795515 (251h1m29.866063155s) [noise=true , address=77.90.31.15:4718 , piece_id=SYYDCERFUSC7JVNEUCUSWTPHOCKPYH5HFEO6KQSVG3FI6JDLXLWQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135276820 (251h1m29.866544471s) [noise=true , address=45.91.116.14:4194 , piece_id=HZXGZJPTHDOYJAQWT4RVKJ752SKAYQS4O5RR5BEKLMQ4SIQJ2SHA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135483198 (251h1m29.866750918s) [noise=true , address=45.91.116.5:4331 , piece_id=DPOTJF7RFLT44ADTZPVH7VR3YUCPYAXEOUZDKERJV22SPSGROM7A, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135835029 (251h1m29.86710268s) [noise=true , address=66.23.193.175:4557 , piece_id=ZSROC6HZO7LIP4SI7SPJCBTRUGPSHB62EISHETVUTQMRJTQBSMTA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135982557 (251h1m29.867250207s) [noise=true , address=45.91.116.8:4068 , piece_id=AKGKSIWCFRFYZGFB22H2Q3FAG6XNNR7LBCMV3KULU4CFGAAQ2YYA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136339348 (251h1m29.867606998s) [noise=true , address=104.36.82.60:4364 , piece_id=LV2P23XGSL6F6KFF7HDI4Z5BCB7WYEFNVYOTHG4Q7A2ERIVCIOAQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136504377 (251h1m29.867772038s) [noise=true , address=45.91.116.13:4157 , piece_id=VVL7322GYRIASBHU36CMMX5G4VWLEG4O2L53RCSK7AG3Z6MZ45VA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136732658 (251h1m29.868000308s) [noise=true , address=45.91.116.7:4021 , piece_id=KDCRCAW6746D4XEY25R33PMTLB5XCNZHD26QXMRQ6D6CO67BMLWQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137048441 (251h1m29.868316111s) [noise=true , address=45.91.116.11:4131 , piece_id=W7QKRAXI7TA3PIU4ECH7GCPRTKGDZAMTRYYL6UJJ5GA7FGTA4JEA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137154821 (251h1m29.86842246s) [noise=true , address=45.91.116.9:4292 , piece_id=ADAI7NEMMI7ZNIB47HHPUGSZ6ZXDZ3Y62HX6IWODYSBJV6RPK5HQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137545365 (251h1m29.868813055s) [noise=true , address=77.90.31.17:4791 , piece_id=CR364E44HFK3FWRAN66ZTZBJACZRE4XQF55FYNEHDET3M2YIMQEA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137595189 (251h1m29.86886284s) [noise=true , address=77.90.31.18:4834 , piece_id=PBGC5NB37NOL3R5DXORQNDCOJTAXWGDMTVCZA6UGET3IBLK6C27Q, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.138058961 (251h1m29.869326611s) [noise=true , address=77.90.31.19:4848 , piece_id=F3KSQJIANH5VCAYYYUQVTTA4CMZGRRHKCQNURLQN3AYHKVDOGGXA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.138607101 (251h1m29.869874751s) [noise=true , address=104.36.82.2:4744 , piece_id=RRUKZCLUW2RZEYTZNCRUIACUQK5UQ5HSDYTC43VDE4KV6HZMTFTQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.139135725 (251h1m29.870403376s) [noise=true , address=104.36.82.5:4851 , piece_id=P5QD3QUIGQHWZL7ZADHRHTJ4R7MFQG3W5MAWSXTL4VWBJVY7AWQQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.145535768 (251h1m29.876803418s) [noise=true , address=104.36.82.8:4994 , piece_id=XE5CSSEZHBRSS42BSBUVZAMFTZQP5BOSNCILEPXCIZPEDFTQLPUA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.330351465 (251h1m30.061619115s) [upload=261106]: Next returned nil segment Aug 19 04:27:49.330371102 (251h1m30.061638752s) [upload=261106]: Waiting for error group managing segments... Aug 19 04:27:49.396836051 (251h1m30.128103681s) [noise=true , address=79.127.201.215:4356 , piece_id=TILCDB2RMDIH7BJ4FW6WQQA2LM5BOWLAGNTLYAYIMKDYM2CMR67A, seg_pos={0 0}, upload=261106]: Done uploading piece. err: <nil> Aug 19 04:27:49.722370750 (251h1m30.4536384s) [noise=true , address=66.23.193.175:4557 , piece_id=ZSROC6HZO7LIP4SI7SPJCBTRUGPSHB62EISHETVUTQMRJTQBSMTA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: <nil> Aug 19 04:28:49.088391363 (251h2m29.819658993s) [noise=true , address=45.91.116.13:4157 , piece_id=VVL7322GYRIASBHU36CMMX5G4VWLEG4O2L53RCSK7AG3Z6MZ45VA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj, address:45.91.116.13:4157): protocol: rpc: dial tcp 45.91.116.13:4157: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088478717 (251h2m29.819746348s) [noise=true , address=104.36.82.8:4994 , piece_id=XE5CSSEZHBRSS42BSBUVZAMFTZQP5BOSNCILEPXCIZPEDFTQLPUA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:13nneaPpsRT7mVEc6cDt7GiZSMTU68Nnk1rr9Lbn5ycZkmQGrB, address:104.36.82.8:4994): protocol: rpc: dial tcp 104.36.82.8:4994: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088549861 (251h2m29.819817491s) [noise=true , address=104.36.82.5:4851 , piece_id=P5QD3QUIGQHWZL7ZADHRHTJ4R7MFQG3W5MAWSXTL4VWBJVY7AWQQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R, address:104.36.82.5:4851): protocol: rpc: dial tcp 104.36.82.5:4851: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088642636 (251h2m29.819910266s) [noise=true , address=104.36.82.44:4880 , piece_id=OWN24XFAQIM7CMFWBVRK6PV4ERW3TBTNA7VIB2TYN27G3TBOPBRQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:104.36.82.44:4880): protocol: rpc: dial tcp 104.36.82.44:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088691026 (251h2m29.819958646s) [noise=true , address=77.90.31.15:4718 , piece_id=SYYDCERFUSC7JVNEUCUSWTPHOCKPYH5HFEO6KQSVG3FI6JDLXLWQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC, address:77.90.31.15:4718): protocol: write tcp 5.161.89.252:52356->77.90.31.15:4718: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088749125 (251h2m29.820016755s) [noise=true , address=45.91.116.8:4068 , piece_id=AKGKSIWCFRFYZGFB22H2Q3FAG6XNNR7LBCMV3KULU4CFGAAQ2YYA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1jN6HbQbPBjk645swQd33LrTfb3LbAWk1dPNXU45zFrgmm6Q82, address:45.91.116.8:4068): protocol: rpc: dial tcp 45.91.116.8:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088802316 (251h2m29.820069946s) [noise=true , address=104.36.82.60:4364 , piece_id=LV2P23XGSL6F6KFF7HDI4Z5BCB7WYEFNVYOTHG4Q7A2ERIVCIOAQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk, address:104.36.82.60:4364): protocol: rpc: dial tcp 104.36.82.60:4364: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088852240 (251h2m29.82011987s) [noise=true , address=77.90.31.17:4791 , piece_id=CR364E44HFK3FWRAN66ZTZBJACZRE4XQF55FYNEHDET3M2YIMQEA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM, address:77.90.31.17:4791): protocol: write tcp 5.161.89.252:21530->77.90.31.17:4791: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089043649 (251h2m29.82031127s) [noise=true , address=45.91.116.9:4292 , piece_id=ADAI7NEMMI7ZNIB47HHPUGSZ6ZXDZ3Y62HX6IWODYSBJV6RPK5HQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12tnWSKAebAwLeGWGRsNnYpcWgbX5UHSVRUnnu9qesUZCK4vY81, address:45.91.116.9:4292): protocol: rpc: dial tcp 45.91.116.9:4292: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089121746 (251h2m29.820389376s) [noise=true , address=77.90.31.18:4834 , piece_id=PBGC5NB37NOL3R5DXORQNDCOJTAXWGDMTVCZA6UGET3IBLK6C27Q, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q, address:77.90.31.18:4834): protocol: rpc: dial tcp 77.90.31.18:4834: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089195093 (251h2m29.820462723s) [noise=true , address=77.90.31.19:4848 , piece_id=F3KSQJIANH5VCAYYYUQVTTA4CMZGRRHKCQNURLQN3AYHKVDOGGXA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD, address:77.90.31.19:4848): protocol: write tcp 5.161.89.252:19210->77.90.31.19:4848: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089270406 (251h2m29.820538036s) [noise=true , address=104.36.82.2:4744 , piece_id=RRUKZCLUW2RZEYTZNCRUIACUQK5UQ5HSDYTC43VDE4KV6HZMTFTQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12A6abQMwnX4PhLYTvkGLinPx4eNeVyS15SGzWiLUq4cwKQ6bmH, address:104.36.82.2:4744): protocol: rpc: dial tcp 104.36.82.2:4744: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089308247 (251h2m29.820575877s) [noise=true , address=45.91.116.5:4331 , piece_id=DPOTJF7RFLT44ADTZPVH7VR3YUCPYAXEOUZDKERJV22SPSGROM7A, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: rpc: dial tcp 45.91.116.5:4331: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089356988 (251h2m29.820624608s) [noise=true , address=45.91.116.7:4021 , piece_id=KDCRCAW6746D4XEY25R33PMTLB5XCNZHD26QXMRQ6D6CO67BMLWQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1bXLNG7g5RJc21AjrfHup6LDTd2dDJGWMzrBhVYwUT7fNm8J2Z, address:45.91.116.7:4021): protocol: rpc: dial tcp 45.91.116.7:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089381043 (251h2m29.820648673s) [noise=true , address=45.91.116.14:4194 , piece_id=HZXGZJPTHDOYJAQWT4RVKJ752SKAYQS4O5RR5BEKLMQ4SIQJ2SHA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:19mdk9cXDR79ZXC4n6rMXFUhpwxMPXFpkPA14ymY24RK1jKkmd, address:45.91.116.14:4194): protocol: rpc: dial tcp 45.91.116.14:4194: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089392665 (251h2m29.820660295s) [noise=true , address=45.91.116.11:4131 , piece_id=W7QKRAXI7TA3PIU4ECH7GCPRTKGDZAMTRYYL6UJJ5GA7FGTA4JEA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:124sCe84Td2UTjNKjgjFhaHbkkcLgvZY3Hn2LnAYYrsx5c14rUE, address:45.91.116.11:4131): protocol: write tcp 5.161.89.252:59470->45.91.116.11:4131: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089421198 (251h2m29.820688829s) [seg_pos={0 0}, upload=261106]: Done waiting for segment. successful: 2 optimal: 14 errs: <nil> Aug 19 04:28:49.140905793 (251h2m29.872173413s) [upload=261106]: Done uploading segments... Aug 19 04:28:49.140920150 (251h2m29.87218777s) [upload=261106]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 2) Duration: 625.077534ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................XXXX................] duration: 877.467006ms FAIL (2025-08-19 04:39:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 7) ======LOGS====== g piece... Aug 19 04:28:13.563886368 (251h1m54.295154018s) [noise=true , address=104.36.82.5:4843 , piece_id=Q3SLO2FDTYYYYOQZARVS3SHAPM5J3GCLNFQ355QAV7U5MWKMZQQA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.564531581 (251h1m54.295799231s) [noise=true , address=45.91.116.7:4037 , piece_id=B42RTCUIHRS5OUFJ5S5E6QWRKEN5H34IMBURUUSSUL53Y2FUYKZQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.564716169 (251h1m54.295983828s) [noise=true , address=104.36.82.15:4289 , piece_id=GVBKZHWTPFDGYCM6U5EUYLBOTGCTTLPDWW2WZKZZEVNG4UZ3XEYA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.565358756 (251h1m54.296626407s) [noise=true , address=77.90.31.21:4891 , piece_id=G57I4V2AOHDBI77GIIULZXTGCFC2BP6CQRX25KA7UNNIJ3WTAGPQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.565475757 (251h1m54.296743417s) [noise=true , address=45.91.116.9:4286 , piece_id=KUMIYTCCEU7XS2NMUTPXDSD7TMNASOBWGNWNDD7L6DMEAPXVIFWA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.566262315 (251h1m54.297529975s) [noise=true , address=104.36.82.44:4880 , piece_id=ZRDRV5AWRCYSUZJANVESK3XUCMLQQXF33WPV6QPX6HAZBYHXOUUQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.566506594 (251h1m54.297774285s) [noise=true , address=45.91.116.12:4243 , piece_id=GNLESUJ3FCKKUC7HOR7Z532H7LQT6ZOTOKLBGRN2R6UCJL4S3VFQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.567576856 (251h1m54.298844507s) [noise=true , address=45.91.116.4:4952 , piece_id=ZXPM75JCQGD3XQ3BTIP4O6SOLR6XCFNBUYQKKD56RTFVCMEGFWDQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.575982240 (251h1m54.30724989s) [noise=true , address=77.90.31.19:4862 , piece_id=7CQOCX2FYKPQCTCBFMN7BMTD3FE2D2X4YIHFLCL22AOSYLKUO33A, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.576556950 (251h1m54.3078246s) [noise=true , address=77.90.31.17:4801 , piece_id=A4D6GQYALBOB46EE7D2KI6422NES4M43E4DTX4CKBLNNP2VHZUJQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.577052442 (251h1m54.308320102s) [noise=true , address=104.36.82.13:4204 , piece_id=LWFS4W2N7K6SWYKXYHZRJACAYYDBIB7OGVETZWKVTWWWJBZPS33A, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.577571397 (251h1m54.308839058s) [noise=true , address=104.36.82.12:4156 , piece_id=RMBTQYXVS5NKE2ON3WW5T2CBE6S7S6T74VVVLMUSM5C44UXGRAYA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.581420654 (251h1m54.312688304s) [noise=true , address=77.90.31.12:4596 , piece_id=AEOFPZ64F5FUTWHLMKFVKQGNGYJYOIU7OZPLYGS7ULR52F5XSNYQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.582252959 (251h1m54.313520609s) [noise=true , address=77.90.31.18:4835 , piece_id=W6FEWYN4QCZC5IQFUG2YXSGKHSKKFRGETXK76LFKAVACLA37H7PA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.672688665 (251h1m54.403956365s) [upload=261114]: Next returned nil segment Aug 19 04:28:13.672710426 (251h1m54.403978086s) [upload=261114]: Waiting for error group managing segments... Aug 19 04:28:13.681638350 (251h1m54.412906s) [noise=true , address=79.127.219.48:4085 , piece_id=AT2YETVN3DCMAPBL45XWQQCTW5FR6JC4PWN3CRIMZPQW5OG3RKKQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:28.955286140 (251h2m9.68655377s) [noise=true , address=77.90.31.12:4596 , piece_id=AEOFPZ64F5FUTWHLMKFVKQGNGYJYOIU7OZPLYGS7ULR52F5XSNYQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: rpc: dial tcp 77.90.31.12:4596: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:45.285087265 (251h2m26.016354885s) [noise=true , address=104.36.82.60:4354 , piece_id=76HWEIKV5672IF34IRITARBMKGTN7OJU6GHQZZCDAP2ZUR2JNJFA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.286367592 (251h2m26.017635222s) [noise=true , address=104.36.82.13:4204 , piece_id=LWFS4W2N7K6SWYKXYHZRJACAYYDBIB7OGVETZWKVTWWWJBZPS33A, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.286429859 (251h2m26.017697489s) [noise=true , address=104.36.82.12:4156 , piece_id=RMBTQYXVS5NKE2ON3WW5T2CBE6S7S6T74VVVLMUSM5C44UXGRAYA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.288231957 (251h2m26.019499578s) [noise=true , address=104.36.82.15:4289 , piece_id=GVBKZHWTPFDGYCM6U5EUYLBOTGCTTLPDWW2WZKZZEVNG4UZ3XEYA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.316902561 (251h2m26.048170191s) [noise=true , address=104.36.82.44:4880 , piece_id=ZRDRV5AWRCYSUZJANVESK3XUCMLQQXF33WPV6QPX6HAZBYHXOUUQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:46.178003461 (251h2m26.90927112s) [noise=true , address=104.36.82.5:4843 , piece_id=Q3SLO2FDTYYYYOQZARVS3SHAPM5J3GCLNFQ355QAV7U5MWKMZQQA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:29:13.506175578 (251h2m54.237443199s) [noise=true , address=45.91.116.6:4988 , piece_id=X36K53BYKX53WMZKQWN2FFKCKTHNLIY3KLLPXMQN2UBKZM2CTT6Q, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1TrcoCHhAJeEykP9hJNpygoPSdgFV5v6GzL48JpyNPiAj5ZJRS, address:45.91.116.6:4988): protocol: rpc: dial tcp 45.91.116.6:4988: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506222607 (251h2m54.237490227s) [noise=true , address=45.91.116.9:4286 , piece_id=KUMIYTCCEU7XS2NMUTPXDSD7TMNASOBWGNWNDD7L6DMEAPXVIFWA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:19DfbHig9tzF4VRHtSWkExwUS2bdZ8GFgKnAD9wvMBG7qaesNa, address:45.91.116.9:4286): protocol: rpc: dial tcp 45.91.116.9:4286: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506254087 (251h2m54.237521717s) [noise=true , address=45.91.116.12:4243 , piece_id=GNLESUJ3FCKKUC7HOR7Z532H7LQT6ZOTOKLBGRN2R6UCJL4S3VFQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1e9VEMmhYq6PxqvTpxsoUHzqYVwujfj1UG7HSZFeiu8CderMpM, address:45.91.116.12:4243): protocol: rpc: dial tcp 45.91.116.12:4243: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506625304 (251h2m54.237892934s) [noise=true , address=77.90.31.21:4891 , piece_id=G57I4V2AOHDBI77GIIULZXTGCFC2BP6CQRX25KA7UNNIJ3WTAGPQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:17RDAerfx8AW5NsgWLTXLNDbuAEWQFT3SVM4iwdmuBzWrML83g, address:77.90.31.21:4891): protocol: rpc: dial tcp 77.90.31.21:4891: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506656563 (251h2m54.237924213s) [noise=true , address=77.90.31.19:4862 , piece_id=7CQOCX2FYKPQCTCBFMN7BMTD3FE2D2X4YIHFLCL22AOSYLKUO33A, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1Tvmo3nSgBPcFYW9MmZQGUeMoD3m3ykJHwVMj6tj69iQKgX3Mz, address:77.90.31.19:4862): protocol: rpc: dial tcp 77.90.31.19:4862: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Aug 19 04:29:13.506689415 (251h2m54.237957045s) [noise=true , address=77.90.31.18:4835 , piece_id=W6FEWYN4QCZC5IQFUG2YXSGKHSKKFRGETXK76LFKAVACLA37H7PA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:12hAQp2Zr7WSaQSTCZf5pwSyuBHHSrZWq5EVz5hFvSA5ddWebqg, address:77.90.31.18:4835): protocol: write tcp 5.161.89.252:27410->77.90.31.18:4835: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506740311 (251h2m54.23800793s) [noise=true , address=45.91.116.7:4037 , piece_id=B42RTCUIHRS5OUFJ5S5E6QWRKEN5H34IMBURUUSSUL53Y2FUYKZQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: rpc: dial tcp 45.91.116.7:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506774885 (251h2m54.238042535s) [noise=true , address=77.90.31.17:4801 , piece_id=A4D6GQYALBOB46EE7D2KI6422NES4M43E4DTX4CKBLNNP2VHZUJQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe, address:77.90.31.17:4801): protocol: write tcp 5.161.89.252:48394->77.90.31.17:4801: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506808788 (251h2m54.238076419s) [noise=true , address=45.91.116.4:4952 , piece_id=ZXPM75JCQGD3XQ3BTIP4O6SOLR6XCFNBUYQKKD56RTFVCMEGFWDQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1PcGuaN6uLz1HVzMgBp4vViKJw2KrmaFatL1w9DHgiYqccMUJ9, address:45.91.116.4:4952): protocol: write tcp 5.161.89.252:61300->45.91.116.4:4952: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506825761 (251h2m54.23809341s) [noise=true , address=77.90.31.13:4645 , piece_id=TGFZGBBRZLA32ZJS3BGT7OSHJW4S34PWMYSQKCZT4RG2IUTGPZSQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: rpc: dial tcp 77.90.31.13:4645: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506906624 (251h2m54.238174313s) [seg_pos={0 0}, upload=261114]: Done waiting for segment. successful: 7 optimal: 14 errs: <nil> Aug 19 04:29:13.523807608 (251h2m54.255075238s) [upload=261114]: Done uploading segments... Aug 19 04:29:13.523824049 (251h2m54.255091679s) [upload=261114]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 7) Duration: 877.497353ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 687.796231ms target: https://ap1.storj.io/login FAIL (2025-08-19 04:39:34 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout Duration: 687.81717ms core satellite ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 217.844117ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-08-19 04:39:33 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 217.867172ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 564.181505ms FAIL (2025-08-19 04:39:32 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 564.202766ms edge gateway us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 8.884742ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-19 04:39:31 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34965->127.0.0.1:53: i/o timeout Duration: 8.927162ms edge linksharing us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 61.282556ms FAIL (2025-08-19 04:39:31 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 61.304107ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 873.192169ms FAIL (2025-08-19 04:39:27 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 873.227266ms edge authservice http bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 104.257817ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-19 04:39:24 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 104.278665ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.040324926s FAIL (2025-08-19 04:39:19 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.040352067s core uplink eu1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 527.200003ms FAIL (2025-08-19 04:39:18 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 527.226123ms edge authservice http bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 1.272001287s FAIL (2025-08-19 04:39:17 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 1.272023899s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 293.221883ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-08-19 04:39:10 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 293.252812ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 165.647704ms FAIL (2025-08-19 04:39:08 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 165.670226ms edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 4.647593132s FAIL (2025-08-19 04:38:59 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.647620213s core uplink ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [.........................................XXXXXX.............] duration: 595.939307ms FAIL (2025-08-19 04:38:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0) ======LOGS====== ad=261108]: Uploading piece... Aug 19 04:27:59.298715587 (251h1m40.029983236s) [noise=true , address=45.91.116.10:4081 , piece_id=VXW7T7RYDQYFA67EV4IP5EFMNLSPHO6YMYO4NCUBCDOSPQWID6KQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.298767684 (251h1m40.030035364s) [noise=true , address=45.91.116.11:4119 , piece_id=6NZDOUCLI5JRQ5XXZMNLBXIVXMHR7NJY6BTCMA22QMNC3ZJJFCMA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299257736 (251h1m40.030525387s) [noise=true , address=45.91.116.10:4083 , piece_id=N7ABFK4IGEFBUNEAQI3SFS7IC6SCOHQD4TN2QOWDUSNRM4ZLXV7A, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299339650 (251h1m40.030607301s) [noise=true , address=77.90.31.21:4878 , piece_id=X3FKRFUU6S3AB6ZPUNPB2HOGLJ5E7U4AWTEFH6PISRIBECP3GVSQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299714204 (251h1m40.030981855s) [noise=true , address=45.91.116.8:4045 , piece_id=OH3KNS4URAIN3T4FLAPSYC2SHQKOEBLJMF2AVG7MXJULLC3P7QYA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.299820754 (251h1m40.031088415s) [noise=true , address=77.90.31.10:4517 , piece_id=QXH4JBJTSA4VLHPS2OUAR3XF7QEL3WSX2JJT7VTZMRBVWS3OIOQQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300136579 (251h1m40.031404229s) [noise=true , address=77.90.31.12:4592 , piece_id=25GKL2MHGGV6IC7JDU5MBJ4MOCCNPGMXQPYXH7A4FFFJ5EZGVZ2Q, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300491886 (251h1m40.031759547s) [noise=true , address=45.91.116.9:4261 , piece_id=RAEAWIKMHIV4VGOZY57ZK36BNZGZ2ATXTXC4YHRABT6VWB6MGILA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.300854618 (251h1m40.032122269s) [noise=true , address=104.36.82.2:4732 , piece_id=WKRORDL2XPRF2KRKZ55EQ2PTPJHPJSQ6NQ4D3VVFK6COGG57KDNQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.301277543 (251h1m40.032545194s) [noise=true , address=45.91.116.14:4190 , piece_id=SGZNGKGYEKPU4GXCULPKYIOONZZXZT6UTO7MDWYOJRJJW4WSG3VA, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.301655164 (251h1m40.032922814s) [noise=true , address=104.36.82.7:4910 , piece_id=R6GR56GOKT2K3AX75OL3BWODTZ4FJY27MIOQWFYJVY4UGR66DIBQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:27:59.302072699 (251h1m40.033340349s) [noise=true , address=104.36.82.16:4294 , piece_id=GT3KQOCWD2YTWBQDAO5QJKYIMZINUF4MESKP6F3P6J73R4IY3NDQ, seg_pos={0 0}, upload=261108]: Uploading piece... Aug 19 04:28:02.354368898 (251h1m43.085636557s) [noise=true , address=77.90.31.21:4878 , piece_id=X3FKRFUU6S3AB6ZPUNPB2HOGLJ5E7U4AWTEFH6PISRIBECP3GVSQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12sFeLTeZ6ox1U2b5dDorbFq1mc5rPXdFjYgUCGFzRmRYv4oNpK, address:77.90.31.21:4878): protocol: write tcp 5.161.89.252:64042->77.90.31.21:4878: write: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:02.385567243 (251h1m43.116834893s) [noise=true , address=77.90.31.12:4592 , piece_id=25GKL2MHGGV6IC7JDU5MBJ4MOCCNPGMXQPYXH7A4FFFJ5EZGVZ2Q, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: write tcp 5.161.89.252:34306->77.90.31.12:4592: write: no route to host; conn closed: op; piecestore: piecestore close: manager closed: conn closed: op Aug 19 04:28:29.225676153 (251h2m9.956943773s) [upload=261108]: Next segment err: context deadline exceeded Aug 19 04:28:29.225998790 (251h2m9.95726642s) [noise=true , address=104.36.82.2:4732 , piece_id=WKRORDL2XPRF2KRKZ55EQ2PTPJHPJSQ6NQ4D3VVFK6COGG57KDNQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE, address:104.36.82.2:4732): protocol: rpc: dial tcp 104.36.82.2:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226039707 (251h2m9.957307326s) [noise=true , address=45.91.116.11:4119 , piece_id=6NZDOUCLI5JRQ5XXZMNLBXIVXMHR7NJY6BTCMA22QMNC3ZJJFCMA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1gAiCZHUi4y1iJcxzca4PEg7kosGQn45pCXhQAA9ss7yk6UThm, address:45.91.116.11:4119): protocol: rpc: dial tcp 45.91.116.11:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226072177 (251h2m9.957339798s) [noise=true , address=45.91.116.8:4045 , piece_id=OH3KNS4URAIN3T4FLAPSYC2SHQKOEBLJMF2AVG7MXJULLC3P7QYA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: rpc: dial tcp 45.91.116.8:4045: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226223943 (251h2m9.957491573s) [noise=true , address=45.91.116.14:4190 , piece_id=SGZNGKGYEKPU4GXCULPKYIOONZZXZT6UTO7MDWYOJRJJW4WSG3VA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: rpc: dial tcp 45.91.116.14:4190: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226274027 (251h2m9.957541647s) [noise=true , address=45.91.116.13:4154 , piece_id=WM56E23Z7FLRF33HYDXONXHODJDHPCJFWGVC3NI7RUTZUESWO4MQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: rpc: dial tcp 45.91.116.13:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226310786 (251h2m9.957578416s) [noise=true , address=77.90.31.17:4771 , piece_id=3BVZK3ZL7N5FC3OJGFFYTVEG7INVMLMG2QBPXX3UC3EJVXHBGW3Q, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: rpc: dial tcp 77.90.31.17:4771: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226348096 (251h2m9.957615726s) [noise=true , address=104.36.82.11:4114 , piece_id=P4RJRUZPRTFPRK5WWHKUVEKJKXGPPPCIV4RPFIZOBO2CPOXSTSIQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226392119 (251h2m9.957659749s) [noise=true , address=45.91.116.10:4081 , piece_id=VXW7T7RYDQYFA67EV4IP5EFMNLSPHO6YMYO4NCUBCDOSPQWID6KQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 5.161.89.252:44604->45.91.116.10:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226421564 (251h2m9.957689195s) [noise=true , address=45.91.116.9:4261 , piece_id=RAEAWIKMHIV4VGOZY57ZK36BNZGZ2ATXTXC4YHRABT6VWB6MGILA, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: rpc: dial tcp 45.91.116.9:4261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226443746 (251h2m9.957711377s) [noise=true , address=45.91.116.4:4940 , piece_id=GYF7CH3463KOWU7DE7WKLYTXYXLTRMPOIK4K3D64ANKOERN33FGQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: write tcp 5.161.89.252:53922->45.91.116.4:4940: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226474684 (251h2m9.957742315s) [noise=true , address=104.36.82.7:4910 , piece_id=R6GR56GOKT2K3AX75OL3BWODTZ4FJY27MIOQWFYJVY4UGR66DIBQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:15uiNvgWc1hPsws7NJjiH5dTx8aBh6PG4fQhsNQTqQTi9MC2Hn, address:104.36.82.7:4910): protocol: rpc: dial tcp 104.36.82.7:4910: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226493810 (251h2m9.95776143s) [noise=true , address=45.91.116.10:4083 , piece_id=N7ABFK4IGEFBUNEAQI3SFS7IC6SCOHQD4TN2QOWDUSNRM4ZLXV7A, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:123WHuy89PAwkQ6AhXenBsQM6HdptYmwJWWqNkGC7P1boNd4K8B, address:45.91.116.10:4083): protocol: rpc: dial tcp 45.91.116.10:4083: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226509199 (251h2m9.957776829s) [noise=true , address=104.36.82.16:4294 , piece_id=GT3KQOCWD2YTWBQDAO5QJKYIMZINUF4MESKP6F3P6J73R4IY3NDQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:12CbfkWK4H84My3e6qhDuAkTrHWsooysz7KE4bk6VoDRDWEgb9e, address:104.36.82.16:4294): protocol: write tcp 5.161.89.252:25886->104.36.82.16:4294: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226527894 (251h2m9.957795524s) [noise=true , address=77.90.31.10:4517 , piece_id=QXH4JBJTSA4VLHPS2OUAR3XF7QEL3WSX2JJT7VTZMRBVWS3OIOQQ, seg_pos={0 0}, upload=261108]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: rpc: dial tcp 77.90.31.10:4517: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:29.226544845 (251h2m9.957812476s) [seg_pos={0 0}, upload=261108]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil> Duration: 595.972287ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 497.715963ms target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 FAIL (2025-08-19 04:38:47 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318": dial tcp: lookup uptime-checks.gateway.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:41477->127.0.0.1:53: i/o timeout Duration: 497.737834ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 686.284451ms target: https://ap1.storj.io/login FAIL (2025-08-19 04:38:45 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 35.213.185.92:443: i/o timeout Duration: 686.303297ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........................................XXXX..............] duration: 658.48703ms FAIL (2025-08-19 04:38:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 2) ======LOGS====== Aug 19 04:27:49.109078986 (251h1m29.840346686s) [upload=261106]: Starting upload Aug 19 04:27:49.109176229 (251h1m29.84044389s) [upload=261106]: Done starting upload Aug 19 04:27:49.109275225 (251h1m29.840542885s) [upload=261106]: Uploading segments... Aug 19 04:27:49.109595368 (251h1m29.840863017s) [upload=261106]: Got next segment. Inline: false Aug 19 04:27:49.109658597 (251h1m29.840926246s) [upload=261106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:27:49.109666732 (251h1m29.840934381s) [upload=261106]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:27:49.134178766 (251h1m29.865446416s) [seg_pos={0 0}, upload=261106]: Begin upload segment... Aug 19 04:27:49.134254959 (251h1m29.865522609s) [seg_pos={0 0}, upload=261106]: Done begin upload segment. Aug 19 04:27:49.134289924 (251h1m29.865557575s) [noise=true , address=104.36.82.44:4880 , piece_id=OWN24XFAQIM7CMFWBVRK6PV4ERW3TBTNA7VIB2TYN27G3TBOPBRQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.134334910 (251h1m29.86560256s) [noise=true , address=79.127.201.215:4356 , piece_id=TILCDB2RMDIH7BJ4FW6WQQA2LM5BOWLAGNTLYAYIMKDYM2CMR67A, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.134795515 (251h1m29.866063155s) [noise=true , address=77.90.31.15:4718 , piece_id=SYYDCERFUSC7JVNEUCUSWTPHOCKPYH5HFEO6KQSVG3FI6JDLXLWQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135276820 (251h1m29.866544471s) [noise=true , address=45.91.116.14:4194 , piece_id=HZXGZJPTHDOYJAQWT4RVKJ752SKAYQS4O5RR5BEKLMQ4SIQJ2SHA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135483198 (251h1m29.866750918s) [noise=true , address=45.91.116.5:4331 , piece_id=DPOTJF7RFLT44ADTZPVH7VR3YUCPYAXEOUZDKERJV22SPSGROM7A, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135835029 (251h1m29.86710268s) [noise=true , address=66.23.193.175:4557 , piece_id=ZSROC6HZO7LIP4SI7SPJCBTRUGPSHB62EISHETVUTQMRJTQBSMTA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.135982557 (251h1m29.867250207s) [noise=true , address=45.91.116.8:4068 , piece_id=AKGKSIWCFRFYZGFB22H2Q3FAG6XNNR7LBCMV3KULU4CFGAAQ2YYA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136339348 (251h1m29.867606998s) [noise=true , address=104.36.82.60:4364 , piece_id=LV2P23XGSL6F6KFF7HDI4Z5BCB7WYEFNVYOTHG4Q7A2ERIVCIOAQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136504377 (251h1m29.867772038s) [noise=true , address=45.91.116.13:4157 , piece_id=VVL7322GYRIASBHU36CMMX5G4VWLEG4O2L53RCSK7AG3Z6MZ45VA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.136732658 (251h1m29.868000308s) [noise=true , address=45.91.116.7:4021 , piece_id=KDCRCAW6746D4XEY25R33PMTLB5XCNZHD26QXMRQ6D6CO67BMLWQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137048441 (251h1m29.868316111s) [noise=true , address=45.91.116.11:4131 , piece_id=W7QKRAXI7TA3PIU4ECH7GCPRTKGDZAMTRYYL6UJJ5GA7FGTA4JEA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137154821 (251h1m29.86842246s) [noise=true , address=45.91.116.9:4292 , piece_id=ADAI7NEMMI7ZNIB47HHPUGSZ6ZXDZ3Y62HX6IWODYSBJV6RPK5HQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137545365 (251h1m29.868813055s) [noise=true , address=77.90.31.17:4791 , piece_id=CR364E44HFK3FWRAN66ZTZBJACZRE4XQF55FYNEHDET3M2YIMQEA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.137595189 (251h1m29.86886284s) [noise=true , address=77.90.31.18:4834 , piece_id=PBGC5NB37NOL3R5DXORQNDCOJTAXWGDMTVCZA6UGET3IBLK6C27Q, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.138058961 (251h1m29.869326611s) [noise=true , address=77.90.31.19:4848 , piece_id=F3KSQJIANH5VCAYYYUQVTTA4CMZGRRHKCQNURLQN3AYHKVDOGGXA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.138607101 (251h1m29.869874751s) [noise=true , address=104.36.82.2:4744 , piece_id=RRUKZCLUW2RZEYTZNCRUIACUQK5UQ5HSDYTC43VDE4KV6HZMTFTQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.139135725 (251h1m29.870403376s) [noise=true , address=104.36.82.5:4851 , piece_id=P5QD3QUIGQHWZL7ZADHRHTJ4R7MFQG3W5MAWSXTL4VWBJVY7AWQQ, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.145535768 (251h1m29.876803418s) [noise=true , address=104.36.82.8:4994 , piece_id=XE5CSSEZHBRSS42BSBUVZAMFTZQP5BOSNCILEPXCIZPEDFTQLPUA, seg_pos={0 0}, upload=261106]: Uploading piece... Aug 19 04:27:49.330351465 (251h1m30.061619115s) [upload=261106]: Next returned nil segment Aug 19 04:27:49.330371102 (251h1m30.061638752s) [upload=261106]: Waiting for error group managing segments... Aug 19 04:27:49.396836051 (251h1m30.128103681s) [noise=true , address=79.127.201.215:4356 , piece_id=TILCDB2RMDIH7BJ4FW6WQQA2LM5BOWLAGNTLYAYIMKDYM2CMR67A, seg_pos={0 0}, upload=261106]: Done uploading piece. err: <nil> Aug 19 04:27:49.722370750 (251h1m30.4536384s) [noise=true , address=66.23.193.175:4557 , piece_id=ZSROC6HZO7LIP4SI7SPJCBTRUGPSHB62EISHETVUTQMRJTQBSMTA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: <nil> Aug 19 04:28:49.088391363 (251h2m29.819658993s) [noise=true , address=45.91.116.13:4157 , piece_id=VVL7322GYRIASBHU36CMMX5G4VWLEG4O2L53RCSK7AG3Z6MZ45VA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1ZMuuRZWAmRdQBHg2PFQCq9gB1uwgDTnZ72bm2ghMv1LRkewUj, address:45.91.116.13:4157): protocol: rpc: dial tcp 45.91.116.13:4157: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088478717 (251h2m29.819746348s) [noise=true , address=104.36.82.8:4994 , piece_id=XE5CSSEZHBRSS42BSBUVZAMFTZQP5BOSNCILEPXCIZPEDFTQLPUA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:13nneaPpsRT7mVEc6cDt7GiZSMTU68Nnk1rr9Lbn5ycZkmQGrB, address:104.36.82.8:4994): protocol: rpc: dial tcp 104.36.82.8:4994: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088549861 (251h2m29.819817491s) [noise=true , address=104.36.82.5:4851 , piece_id=P5QD3QUIGQHWZL7ZADHRHTJ4R7MFQG3W5MAWSXTL4VWBJVY7AWQQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1fTtTieEUquaKNUNzqK98PkX7tVxjsiNeMLjz8kQJwdLne7d9R, address:104.36.82.5:4851): protocol: rpc: dial tcp 104.36.82.5:4851: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088642636 (251h2m29.819910266s) [noise=true , address=104.36.82.44:4880 , piece_id=OWN24XFAQIM7CMFWBVRK6PV4ERW3TBTNA7VIB2TYN27G3TBOPBRQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn, address:104.36.82.44:4880): protocol: rpc: dial tcp 104.36.82.44:4880: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088691026 (251h2m29.819958646s) [noise=true , address=77.90.31.15:4718 , piece_id=SYYDCERFUSC7JVNEUCUSWTPHOCKPYH5HFEO6KQSVG3FI6JDLXLWQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1P53pBJhZqd4Kn47H6UcmxkDSh11qKmUaMhKTk3bGBF4FbmgMC, address:77.90.31.15:4718): protocol: write tcp 5.161.89.252:52356->77.90.31.15:4718: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088749125 (251h2m29.820016755s) [noise=true , address=45.91.116.8:4068 , piece_id=AKGKSIWCFRFYZGFB22H2Q3FAG6XNNR7LBCMV3KULU4CFGAAQ2YYA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1jN6HbQbPBjk645swQd33LrTfb3LbAWk1dPNXU45zFrgmm6Q82, address:45.91.116.8:4068): protocol: rpc: dial tcp 45.91.116.8:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088802316 (251h2m29.820069946s) [noise=true , address=104.36.82.60:4364 , piece_id=LV2P23XGSL6F6KFF7HDI4Z5BCB7WYEFNVYOTHG4Q7A2ERIVCIOAQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk, address:104.36.82.60:4364): protocol: rpc: dial tcp 104.36.82.60:4364: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.088852240 (251h2m29.82011987s) [noise=true , address=77.90.31.17:4791 , piece_id=CR364E44HFK3FWRAN66ZTZBJACZRE4XQF55FYNEHDET3M2YIMQEA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1bFEmP78qGhyHhXr3QNVptdiWQ4No4nrb31qj6DPgmJLcHYKiM, address:77.90.31.17:4791): protocol: write tcp 5.161.89.252:21530->77.90.31.17:4791: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089043649 (251h2m29.82031127s) [noise=true , address=45.91.116.9:4292 , piece_id=ADAI7NEMMI7ZNIB47HHPUGSZ6ZXDZ3Y62HX6IWODYSBJV6RPK5HQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12tnWSKAebAwLeGWGRsNnYpcWgbX5UHSVRUnnu9qesUZCK4vY81, address:45.91.116.9:4292): protocol: rpc: dial tcp 45.91.116.9:4292: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089121746 (251h2m29.820389376s) [noise=true , address=77.90.31.18:4834 , piece_id=PBGC5NB37NOL3R5DXORQNDCOJTAXWGDMTVCZA6UGET3IBLK6C27Q, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1sfZTiYg2UFBmB45CB8FrBeMvmDoKMQ6Mt6zQHKgD5D8cwYe6q, address:77.90.31.18:4834): protocol: rpc: dial tcp 77.90.31.18:4834: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089195093 (251h2m29.820462723s) [noise=true , address=77.90.31.19:4848 , piece_id=F3KSQJIANH5VCAYYYUQVTTA4CMZGRRHKCQNURLQN3AYHKVDOGGXA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD, address:77.90.31.19:4848): protocol: write tcp 5.161.89.252:19210->77.90.31.19:4848: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089270406 (251h2m29.820538036s) [noise=true , address=104.36.82.2:4744 , piece_id=RRUKZCLUW2RZEYTZNCRUIACUQK5UQ5HSDYTC43VDE4KV6HZMTFTQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12A6abQMwnX4PhLYTvkGLinPx4eNeVyS15SGzWiLUq4cwKQ6bmH, address:104.36.82.2:4744): protocol: rpc: dial tcp 104.36.82.2:4744: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089308247 (251h2m29.820575877s) [noise=true , address=45.91.116.5:4331 , piece_id=DPOTJF7RFLT44ADTZPVH7VR3YUCPYAXEOUZDKERJV22SPSGROM7A, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:12UvDrJhqPFda5Vu8NEGBVBYXHoXLFWnKHNJqrLLGgfVi14sZsJ, address:45.91.116.5:4331): protocol: rpc: dial tcp 45.91.116.5:4331: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089356988 (251h2m29.820624608s) [noise=true , address=45.91.116.7:4021 , piece_id=KDCRCAW6746D4XEY25R33PMTLB5XCNZHD26QXMRQ6D6CO67BMLWQ, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:1bXLNG7g5RJc21AjrfHup6LDTd2dDJGWMzrBhVYwUT7fNm8J2Z, address:45.91.116.7:4021): protocol: rpc: dial tcp 45.91.116.7:4021: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089381043 (251h2m29.820648673s) [noise=true , address=45.91.116.14:4194 , piece_id=HZXGZJPTHDOYJAQWT4RVKJ752SKAYQS4O5RR5BEKLMQ4SIQJ2SHA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:19mdk9cXDR79ZXC4n6rMXFUhpwxMPXFpkPA14ymY24RK1jKkmd, address:45.91.116.14:4194): protocol: rpc: dial tcp 45.91.116.14:4194: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089392665 (251h2m29.820660295s) [noise=true , address=45.91.116.11:4131 , piece_id=W7QKRAXI7TA3PIU4ECH7GCPRTKGDZAMTRYYL6UJJ5GA7FGTA4JEA, seg_pos={0 0}, upload=261106]: Done uploading piece. err: ecclient: upload failed (node:124sCe84Td2UTjNKjgjFhaHbkkcLgvZY3Hn2LnAYYrsx5c14rUE, address:45.91.116.11:4131): protocol: write tcp 5.161.89.252:59470->45.91.116.11:4131: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:49.089421198 (251h2m29.820688829s) [seg_pos={0 0}, upload=261106]: Done waiting for segment. successful: 2 optimal: 14 errs: <nil> Aug 19 04:28:49.140905793 (251h2m29.872173413s) [upload=261106]: Done uploading segments... Aug 19 04:28:49.140920150 (251h2m29.87218777s) [upload=261106]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 2) Duration: 658.510164ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 491.018783ms FAIL (2025-08-19 04:38:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 491.036605ms edge gateway us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 4.73497979s FAIL (2025-08-19 04:38:34 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.735002734s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 951.919711ms FAIL (2025-08-19 04:38:31 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 951.949497ms core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.815481396s FAIL (2025-08-19 04:38:30 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 1.815495271s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........................................XXXX...............] duration: 754.031246ms FAIL (2025-08-19 04:38:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 7) ======LOGS====== g piece... Aug 19 04:28:13.563886368 (251h1m54.295154018s) [noise=true , address=104.36.82.5:4843 , piece_id=Q3SLO2FDTYYYYOQZARVS3SHAPM5J3GCLNFQ355QAV7U5MWKMZQQA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.564531581 (251h1m54.295799231s) [noise=true , address=45.91.116.7:4037 , piece_id=B42RTCUIHRS5OUFJ5S5E6QWRKEN5H34IMBURUUSSUL53Y2FUYKZQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.564716169 (251h1m54.295983828s) [noise=true , address=104.36.82.15:4289 , piece_id=GVBKZHWTPFDGYCM6U5EUYLBOTGCTTLPDWW2WZKZZEVNG4UZ3XEYA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.565358756 (251h1m54.296626407s) [noise=true , address=77.90.31.21:4891 , piece_id=G57I4V2AOHDBI77GIIULZXTGCFC2BP6CQRX25KA7UNNIJ3WTAGPQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.565475757 (251h1m54.296743417s) [noise=true , address=45.91.116.9:4286 , piece_id=KUMIYTCCEU7XS2NMUTPXDSD7TMNASOBWGNWNDD7L6DMEAPXVIFWA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.566262315 (251h1m54.297529975s) [noise=true , address=104.36.82.44:4880 , piece_id=ZRDRV5AWRCYSUZJANVESK3XUCMLQQXF33WPV6QPX6HAZBYHXOUUQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.566506594 (251h1m54.297774285s) [noise=true , address=45.91.116.12:4243 , piece_id=GNLESUJ3FCKKUC7HOR7Z532H7LQT6ZOTOKLBGRN2R6UCJL4S3VFQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.567576856 (251h1m54.298844507s) [noise=true , address=45.91.116.4:4952 , piece_id=ZXPM75JCQGD3XQ3BTIP4O6SOLR6XCFNBUYQKKD56RTFVCMEGFWDQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.575982240 (251h1m54.30724989s) [noise=true , address=77.90.31.19:4862 , piece_id=7CQOCX2FYKPQCTCBFMN7BMTD3FE2D2X4YIHFLCL22AOSYLKUO33A, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.576556950 (251h1m54.3078246s) [noise=true , address=77.90.31.17:4801 , piece_id=A4D6GQYALBOB46EE7D2KI6422NES4M43E4DTX4CKBLNNP2VHZUJQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.577052442 (251h1m54.308320102s) [noise=true , address=104.36.82.13:4204 , piece_id=LWFS4W2N7K6SWYKXYHZRJACAYYDBIB7OGVETZWKVTWWWJBZPS33A, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.577571397 (251h1m54.308839058s) [noise=true , address=104.36.82.12:4156 , piece_id=RMBTQYXVS5NKE2ON3WW5T2CBE6S7S6T74VVVLMUSM5C44UXGRAYA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.581420654 (251h1m54.312688304s) [noise=true , address=77.90.31.12:4596 , piece_id=AEOFPZ64F5FUTWHLMKFVKQGNGYJYOIU7OZPLYGS7ULR52F5XSNYQ, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.582252959 (251h1m54.313520609s) [noise=true , address=77.90.31.18:4835 , piece_id=W6FEWYN4QCZC5IQFUG2YXSGKHSKKFRGETXK76LFKAVACLA37H7PA, seg_pos={0 0}, upload=261114]: Uploading piece... Aug 19 04:28:13.672688665 (251h1m54.403956365s) [upload=261114]: Next returned nil segment Aug 19 04:28:13.672710426 (251h1m54.403978086s) [upload=261114]: Waiting for error group managing segments... Aug 19 04:28:13.681638350 (251h1m54.412906s) [noise=true , address=79.127.219.48:4085 , piece_id=AT2YETVN3DCMAPBL45XWQQCTW5FR6JC4PWN3CRIMZPQW5OG3RKKQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:28.955286140 (251h2m9.68655377s) [noise=true , address=77.90.31.12:4596 , piece_id=AEOFPZ64F5FUTWHLMKFVKQGNGYJYOIU7OZPLYGS7ULR52F5XSNYQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1xgzDjjKfA3YT4tjGq6Esw9xfhA4xWMWnDbyAmNFUcP85qyFGf, address:77.90.31.12:4596): protocol: rpc: dial tcp 77.90.31.12:4596: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:28:45.285087265 (251h2m26.016354885s) [noise=true , address=104.36.82.60:4354 , piece_id=76HWEIKV5672IF34IRITARBMKGTN7OJU6GHQZZCDAP2ZUR2JNJFA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.286367592 (251h2m26.017635222s) [noise=true , address=104.36.82.13:4204 , piece_id=LWFS4W2N7K6SWYKXYHZRJACAYYDBIB7OGVETZWKVTWWWJBZPS33A, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.286429859 (251h2m26.017697489s) [noise=true , address=104.36.82.12:4156 , piece_id=RMBTQYXVS5NKE2ON3WW5T2CBE6S7S6T74VVVLMUSM5C44UXGRAYA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.288231957 (251h2m26.019499578s) [noise=true , address=104.36.82.15:4289 , piece_id=GVBKZHWTPFDGYCM6U5EUYLBOTGCTTLPDWW2WZKZZEVNG4UZ3XEYA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:45.316902561 (251h2m26.048170191s) [noise=true , address=104.36.82.44:4880 , piece_id=ZRDRV5AWRCYSUZJANVESK3XUCMLQQXF33WPV6QPX6HAZBYHXOUUQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:28:46.178003461 (251h2m26.90927112s) [noise=true , address=104.36.82.5:4843 , piece_id=Q3SLO2FDTYYYYOQZARVS3SHAPM5J3GCLNFQ355QAV7U5MWKMZQQA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: <nil> Aug 19 04:29:13.506175578 (251h2m54.237443199s) [noise=true , address=45.91.116.6:4988 , piece_id=X36K53BYKX53WMZKQWN2FFKCKTHNLIY3KLLPXMQN2UBKZM2CTT6Q, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1TrcoCHhAJeEykP9hJNpygoPSdgFV5v6GzL48JpyNPiAj5ZJRS, address:45.91.116.6:4988): protocol: rpc: dial tcp 45.91.116.6:4988: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506222607 (251h2m54.237490227s) [noise=true , address=45.91.116.9:4286 , piece_id=KUMIYTCCEU7XS2NMUTPXDSD7TMNASOBWGNWNDD7L6DMEAPXVIFWA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:19DfbHig9tzF4VRHtSWkExwUS2bdZ8GFgKnAD9wvMBG7qaesNa, address:45.91.116.9:4286): protocol: rpc: dial tcp 45.91.116.9:4286: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506254087 (251h2m54.237521717s) [noise=true , address=45.91.116.12:4243 , piece_id=GNLESUJ3FCKKUC7HOR7Z532H7LQT6ZOTOKLBGRN2R6UCJL4S3VFQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1e9VEMmhYq6PxqvTpxsoUHzqYVwujfj1UG7HSZFeiu8CderMpM, address:45.91.116.12:4243): protocol: rpc: dial tcp 45.91.116.12:4243: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506625304 (251h2m54.237892934s) [noise=true , address=77.90.31.21:4891 , piece_id=G57I4V2AOHDBI77GIIULZXTGCFC2BP6CQRX25KA7UNNIJ3WTAGPQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:17RDAerfx8AW5NsgWLTXLNDbuAEWQFT3SVM4iwdmuBzWrML83g, address:77.90.31.21:4891): protocol: rpc: dial tcp 77.90.31.21:4891: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506656563 (251h2m54.237924213s) [noise=true , address=77.90.31.19:4862 , piece_id=7CQOCX2FYKPQCTCBFMN7BMTD3FE2D2X4YIHFLCL22AOSYLKUO33A, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1Tvmo3nSgBPcFYW9MmZQGUeMoD3m3ykJHwVMj6tj69iQKgX3Mz, address:77.90.31.19:4862): protocol: rpc: dial tcp 77.90.31.19:4862: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded Aug 19 04:29:13.506689415 (251h2m54.237957045s) [noise=true , address=77.90.31.18:4835 , piece_id=W6FEWYN4QCZC5IQFUG2YXSGKHSKKFRGETXK76LFKAVACLA37H7PA, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:12hAQp2Zr7WSaQSTCZf5pwSyuBHHSrZWq5EVz5hFvSA5ddWebqg, address:77.90.31.18:4835): protocol: write tcp 5.161.89.252:27410->77.90.31.18:4835: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506740311 (251h2m54.23800793s) [noise=true , address=45.91.116.7:4037 , piece_id=B42RTCUIHRS5OUFJ5S5E6QWRKEN5H34IMBURUUSSUL53Y2FUYKZQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: rpc: dial tcp 45.91.116.7:4037: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506774885 (251h2m54.238042535s) [noise=true , address=77.90.31.17:4801 , piece_id=A4D6GQYALBOB46EE7D2KI6422NES4M43E4DTX4CKBLNNP2VHZUJQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe, address:77.90.31.17:4801): protocol: write tcp 5.161.89.252:48394->77.90.31.17:4801: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506808788 (251h2m54.238076419s) [noise=true , address=45.91.116.4:4952 , piece_id=ZXPM75JCQGD3XQ3BTIP4O6SOLR6XCFNBUYQKKD56RTFVCMEGFWDQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1PcGuaN6uLz1HVzMgBp4vViKJw2KrmaFatL1w9DHgiYqccMUJ9, address:45.91.116.4:4952): protocol: write tcp 5.161.89.252:61300->45.91.116.4:4952: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506825761 (251h2m54.23809341s) [noise=true , address=77.90.31.13:4645 , piece_id=TGFZGBBRZLA32ZJS3BGT7OSHJW4S34PWMYSQKCZT4RG2IUTGPZSQ, seg_pos={0 0}, upload=261114]: Done uploading piece. err: ecclient: upload failed (node:1b2aaYQ4o7X5yLcXG3moJ3d4oxFoNSCwsqacwg9mshJ4MPoGdg, address:77.90.31.13:4645): protocol: rpc: dial tcp 77.90.31.13:4645: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 19 04:29:13.506906624 (251h2m54.238174313s) [seg_pos={0 0}, upload=261114]: Done waiting for segment. successful: 7 optimal: 14 errs: <nil> Aug 19 04:29:13.523807608 (251h2m54.255075238s) [upload=261114]: Done uploading segments... Aug 19 04:29:13.523824049 (251h2m54.255091679s) [upload=261114]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 7) Duration: 754.05464ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 60.987251ms FAIL (2025-08-19 04:38:29 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 61.016205ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 894.264884ms FAIL (2025-08-19 04:38:29 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 894.311111ms edge authservice http bgp ap1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 3.175239ms target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-08-19 04:38:28 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34965->127.0.0.1:53: i/o timeout Duration: 3.189597ms edge linksharing us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 277.86282ms FAIL (2025-08-19 04:38:25 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp: lookup auth.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:26171->127.0.0.1:53: i/o timeout Duration: 277.879771ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 565.829935ms FAIL (2025-08-19 04:38:21 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:34390->127.0.0.1:53: i/o timeout Duration: 565.903275ms edge authservice http bgp eu1

Orbiter Check History

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)

checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)