Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 121036 reports (Page 1072 of 2421)
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
3 out of 60 is failed (threshold=3) [.......................................................XXX..]
duration:
49.573552ms
FAIL (2025-08-31 10:35:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 49.59923ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...]
duration:
873.596698ms
FAIL (2025-08-31 10:35:23 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 873.616184ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
2.246487273s
FAIL (2025-08-31 10:35:18 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.246505087s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
250.922683ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-31 10:35:18 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:29236->100.100.100.100:53: i/o timeout
Duration: 250.945004ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
53.016884ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-31 10:35:17 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:29236->100.100.100.100:53: i/o timeout
Duration: 53.032584ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
166.088426ms
FAIL (2025-08-31 10:35:13 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 166.109686ms core uplink us1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.073733579s
FAIL (2025-08-31 10:35:13 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.073759689s core uplink ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....]
duration:
142.404534ms
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-08-31 10:35:13 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:51715->100.100.100.100:53: i/o timeout
Duration: 142.427727ms edge linksharing bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
3 out of 60 is failed (threshold=3) [........................................................XX.X]
duration:
1m0.035080608s
FAIL (2025-08-31 10:35:11 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
]: Done starting upload
Aug 31 10:34:11.918431848 (44h25m47.271216976s) [upload=39144]: Uploading segments...
Aug 31 10:34:11.918666358 (44h25m47.271451487s) [upload=39144]: Got next segment. Inline: false
Aug 31 10:34:11.918710522 (44h25m47.271495651s) [upload=39144]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 31 10:34:11.918716083 (44h25m47.271501211s) [upload=39144]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 31 10:34:11.948428753 (44h25m47.301213881s) [seg_pos={0 0}, upload=39144]: Begin upload segment...
Aug 31 10:34:11.948520716 (44h25m47.301305855s) [seg_pos={0 0}, upload=39144]: Done begin upload segment.
Aug 31 10:34:11.948583043 (44h25m47.301368181s) [noise=true , address=77.90.31.18:4809     , piece_id=ERWBBLHSZG5KDEEHWYRQ7ELF4MDY56HOIQKZFY2RVDCSIWHVFQ5A, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.948598132 (44h25m47.30138327s) [noise=true , address=77.90.31.12:4606     , piece_id=3CZWUX2I2WGXNONKEQSJ2K2JFJ4WQCRNW6BPUT5ZEOTT5SDM42ZA, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.949040364 (44h25m47.301825492s) [noise=true , address=64.49.13.155:4920    , piece_id=LU22ZPJUZ7D6M73SPWMYQJO2HVGRF6CSYDMKIDUQ4DIEL2SUEPMQ, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.949243286 (44h25m47.302028415s) [noise=true , address=45.91.116.10:4085    , piece_id=QWIYKDXVXL5SBXJFPRCDPPNMKVHLFOFQWBRLFS6HQTRL36LOPVOA, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.949423486 (44h25m47.302208613s) [noise=true , address=104.36.82.3:4781     , piece_id=ZPLNU5S4WXLVG42Z4WDZNTF2FE6NE5KVUZPLRVHI36D3345RH2DQ, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.949775118 (44h25m47.302560246s) [noise=true , address=104.36.82.9:4023     , piece_id=VV4L3G7XJYCMNHURBZCIMUWV3K5GIDSYZ5KOE3Y7G5WA4D2CDTQA, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.949830602 (44h25m47.30261574s) [noise=true , address=104.36.82.23:4447    , piece_id=BWVQONFCYG4CEWA6YZZNO2WW6DBT65OFB6PVVPXYPEXQQNXZPP2Q, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.950138983 (44h25m47.30292411s) [noise=true , address=77.90.31.17:4802     , piece_id=6V75XMG7P2HVBNS4UAX3TMUJQWEQBXNINWMPEGRRN3IG727ZUTXA, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.950465297 (44h25m47.303250436s) [noise=true , address=104.36.82.35:4586    , piece_id=OC4GI576GB4IIRTOQBSQTXKWIMSA4ZWD6XUA2LFLP3SO2R27ZSJQ, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.950541079 (44h25m47.303326218s) [noise=true , address=104.36.82.4:4836     , piece_id=KL54VE7KXNUL5BXXOQSTRLHT6LGCMUMDS3UT4LQJFSEKRJBPNHVQ, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.950903583 (44h25m47.30368871s) [noise=true , address=77.90.31.11:4571     , piece_id=J6TYYSLVXWU473L6HS6JVKDE4SXKPN6E44LDKRWXWB4GB7SXRXEA, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.951001035 (44h25m47.303786173s) [noise=true , address=45.91.116.12:4250    , piece_id=HPCFIJFY7BOPDZI26YCESWFQOQXL6QO4YVB5QBEXLX64YWX7SOKA, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.951335696 (44h25m47.304120824s) [noise=true , address=77.90.31.15:4727     , piece_id=2ID6YIODSHC54K322CHYBHYSTBAR4JJ2SSXLC3B2CJUOJLEW76PQ, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.951619130 (44h25m47.304404267s) [noise=true , address=45.91.116.9:4281     , piece_id=IILA62U7HS2VIDUEHAWDZF57CR3KRS3DEVEA534VHZFKYFQHBP4Q, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.951709138 (44h25m47.304494266s) [noise=true , address=104.36.82.60:4341    , piece_id=5FVC2NCMIZDPTDI36S5GGWYN334AYBQJFLNULSBHNVTW33IDIKXQ, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.952097720 (44h25m47.304882848s) [noise=true , address=104.36.82.44:4894    , piece_id=VFGGTZK56ZZU2CDGGD7LRB6VSNPXKURHNUM3OMGO65B33EGYLAYA, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.952346469 (44h25m47.305131607s) [noise=true , address=104.36.82.10:4084    , piece_id=HHNN2V3DV3FPFQR74VIXSDQEEQORRQVQWNMD4TV4AKFVND3XE7JA, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:11.952907605 (44h25m47.305692733s) [noise=true , address=104.36.82.55:4218    , piece_id=3LZVTTDWUXIA5XOP5BQCR7GU42JFAYX3ZVLTN2K3USCWVKHZCPUA, seg_pos={0 0}, upload=39144]: Uploading piece...
Aug 31 10:34:12.088454329 (44h25m47.441239458s) [upload=39144]: Next returned nil segment
Aug 31 10:34:12.088469057 (44h25m47.441254185s) [upload=39144]: Waiting for error group managing segments...
Aug 31 10:34:12.100614854 (44h25m47.453399982s) [noise=true , address=104.36.82.55:4218    , piece_id=3LZVTTDWUXIA5XOP5BQCR7GU42JFAYX3ZVLTN2K3USCWVKHZCPUA, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.101046446 (44h25m47.453831575s) [noise=true , address=104.36.82.23:4447    , piece_id=BWVQONFCYG4CEWA6YZZNO2WW6DBT65OFB6PVVPXYPEXQQNXZPP2Q, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.101530748 (44h25m47.454315866s) [noise=true , address=104.36.82.44:4894    , piece_id=VFGGTZK56ZZU2CDGGD7LRB6VSNPXKURHNUM3OMGO65B33EGYLAYA, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.102121381 (44h25m47.454906509s) [noise=true , address=104.36.82.10:4084    , piece_id=HHNN2V3DV3FPFQR74VIXSDQEEQORRQVQWNMD4TV4AKFVND3XE7JA, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.102260693 (44h25m47.455068754s) [noise=true , address=104.36.82.60:4341    , piece_id=5FVC2NCMIZDPTDI36S5GGWYN334AYBQJFLNULSBHNVTW33IDIKXQ, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.103029740 (44h25m47.455814859s) [noise=true , address=104.36.82.3:4781     , piece_id=ZPLNU5S4WXLVG42Z4WDZNTF2FE6NE5KVUZPLRVHI36D3345RH2DQ, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.103572653 (44h25m47.456357781s) [noise=true , address=104.36.82.4:4836     , piece_id=KL54VE7KXNUL5BXXOQSTRLHT6LGCMUMDS3UT4LQJFSEKRJBPNHVQ, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.114746190 (44h25m47.467531328s) [noise=true , address=104.36.82.35:4586    , piece_id=OC4GI576GB4IIRTOQBSQTXKWIMSA4ZWD6XUA2LFLP3SO2R27ZSJQ, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.124938038 (44h25m47.477723135s) [noise=true , address=104.36.82.9:4023     , piece_id=VV4L3G7XJYCMNHURBZCIMUWV3K5GIDSYZ5KOE3Y7G5WA4D2CDTQA, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.133958631 (44h25m47.486743739s) [noise=true , address=45.91.116.12:4250    , piece_id=HPCFIJFY7BOPDZI26YCESWFQOQXL6QO4YVB5QBEXLX64YWX7SOKA, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.141853765 (44h25m47.494638873s) [noise=true , address=45.91.116.10:4085    , piece_id=QWIYKDXVXL5SBXJFPRCDPPNMKVHLFOFQWBRLFS6HQTRL36LOPVOA, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.155129440 (44h25m47.507914548s) [noise=true , address=45.91.116.9:4281     , piece_id=IILA62U7HS2VIDUEHAWDZF57CR3KRS3DEVEA534VHZFKYFQHBP4Q, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:34:12.515214103 (44h25m47.867999211s) [noise=true , address=64.49.13.155:4920    , piece_id=LU22ZPJUZ7D6M73SPWMYQJO2HVGRF6CSYDMKIDUQ4DIEL2SUEPMQ, seg_pos={0 0}, upload=39144]: Done uploading piece. err: <nil>
Aug 31 10:35:11.903704783 (44h26m47.256489911s) [noise=true , address=77.90.31.18:4809     , piece_id=ERWBBLHSZG5KDEEHWYRQ7ELF4MDY56HOIQKZFY2RVDCSIWHVFQ5A, seg_pos={0 0}, upload=39144]: Done uploading piece. err: ecclient: upload failed (node:1ZkWnew57Zj3H7XoUZHPo57Rzfw5awa7DYwuc7chcD4bJ8aGPz, address:77.90.31.18:4809): protocol: rpc: dial tcp 77.90.31.18:4809: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:35:11.903785335 (44h26m47.256570473s) [noise=true , address=77.90.31.12:4606     , piece_id=3CZWUX2I2WGXNONKEQSJ2K2JFJ4WQCRNW6BPUT5ZEOTT5SDM42ZA, seg_pos={0 0}, upload=39144]: Done uploading piece. err: ecclient: upload failed (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs, address:77.90.31.12:4606): protocol: write tcp 5.161.89.252:35480->77.90.31.12:4606: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:35:11.903793991 (44h26m47.256579129s) [noise=true , address=77.90.31.11:4571     , piece_id=J6TYYSLVXWU473L6HS6JVKDE4SXKPN6E44LDKRWXWB4GB7SXRXEA, seg_pos={0 0}, upload=39144]: Done uploading piece. err: ecclient: upload failed (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy, address:77.90.31.11:4571): protocol: rpc: dial tcp 77.90.31.11:4571: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:35:11.903883701 (44h26m47.256668828s) [noise=true , address=77.90.31.17:4802     , piece_id=6V75XMG7P2HVBNS4UAX3TMUJQWEQBXNINWMPEGRRN3IG727ZUTXA, seg_pos={0 0}, upload=39144]: Done uploading piece. err: ecclient: upload failed (node:12hiNtWkLwWMYr8rPN9ukEKQou5Eko2fD9ScXsqBKk5oX5wxgHy, address:77.90.31.17:4802): protocol: write tcp 5.161.89.252:61386->77.90.31.17:4802: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:35:11.903896284 (44h26m47.256681412s) [noise=true , address=77.90.31.15:4727     , piece_id=2ID6YIODSHC54K322CHYBHYSTBAR4JJ2SSXLC3B2CJUOJLEW76PQ, seg_pos={0 0}, upload=39144]: Done uploading piece. err: ecclient: upload failed (node:1xoAbv6zJuG9LjyCdsCrTWQaCDyLrWyv8RCrMTiqNqazoEwD1M, address:77.90.31.15:4727): protocol: rpc: dial tcp 77.90.31.15:4727: i/o timeout; context deadline exceeded
Aug 31 10:35:11.903968029 (44h26m47.256753156s) [seg_pos={0 0}, upload=39144]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Aug 31 10:35:11.936716434 (44h26m47.289501572s) [upload=39144]: Done uploading segments...
Aug 31 10:35:11.936750909 (44h26m47.289536036s) [upload=39144]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.035105384s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...]
duration:
277.810465ms
target:
https://eu1.storj.io/login
FAIL (2025-08-31 10:35:08 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 277.834409ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...]
duration:
2.828854541s
FAIL (2025-08-31 10:35:07 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.828874588s core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [........................................................XXX.]
duration:
400.946345ms
FAIL (2025-08-31 10:35:02 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 400.962766ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration:
30.026278178s
FAIL (2025-08-31 10:34:59 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Aug 31 10:34:29.549329333 (44h26m4.902114441s) [upload=39149]: Starting upload
Aug 31 10:34:29.549376531 (44h26m4.902161639s) [upload=39149]: Done starting upload
Aug 31 10:34:29.549472161 (44h26m4.90225726s) [upload=39149]: Uploading segments...
Aug 31 10:34:29.549610943 (44h26m4.902396051s) [upload=39149]: Got next segment. Inline: false
Aug 31 10:34:29.549642322 (44h26m4.90242743s) [upload=39149]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 31 10:34:29.549646359 (44h26m4.902431467s) [upload=39149]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 31 10:34:29.576062493 (44h26m4.928847601s) [seg_pos={0 0}, upload=39149]: Begin upload segment...
Aug 31 10:34:29.576087689 (44h26m4.928872797s) [seg_pos={0 0}, upload=39149]: Done begin upload segment.
Aug 31 10:34:29.576104662 (44h26m4.928889771s) [noise=true , address=45.91.116.12:4227    , piece_id=VOYKGU7MXSETY2TG7RYXTVTTR24IATHZZYXD6HMJ3ZD7KLVX5S3Q, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.576143295 (44h26m4.928928403s) [noise=true , address=77.90.31.13:4627     , piece_id=UNDQ2FFZPDE7LYBIITU3XDWZJFDM46LF23LTLCCQBTKXZOHOBJEA, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.576424073 (44h26m4.929209182s) [noise=true , address=45.91.116.5:4297     , piece_id=YWCTLPORKCZ7HALUS2GI4IFGTE3LB75FIG6XTG73TLTQXBST2JCQ, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.576435745 (44h26m4.929220843s) [noise=true , address=45.91.116.6:4975     , piece_id=KJ4I2Y23N7O57QTVMW5CTUM4NWJDQAXENHGE3HA7OZLSWEP7NYQA, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.576639198 (44h26m4.929424306s) [noise=true , address=104.36.82.5:4840     , piece_id=MBELIOT2GV75WHQRT7NDOOH4MC6TOTFWVYMKUQ3IEUE5Z4ITHUDQ, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.576734377 (44h26m4.929519506s) [noise=true , address=45.91.116.12:4225    , piece_id=RZQMHRRFC7AGQBOWTST7XA4VSJJMWYFQUEWKLTQPS7VCU7HYU3SA, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.576844465 (44h26m4.929629573s) [noise=true , address=45.91.116.13:4154    , piece_id=SUCBVWPTTJA7DQ3YHMIYHXKLCPBZ7XMICT46RUKNGLRWPPNFQKMA, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.576998555 (44h26m4.929783663s) [noise=true , address=77.90.31.15:4698     , piece_id=MUAYBTWDOH3K2OD5XRIXLZE6TPL5UQFGQCUA722PK3PL365K4MTA, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.577050703 (44h26m4.929835811s) [noise=true , address=45.91.116.11:4119    , piece_id=PNSXBR3VUSWMWKSBKAZBK3E2J4NWS2XTQUFQJHJUMNLOTVXE7UXQ, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.577297487 (44h26m4.930082586s) [noise=true , address=45.91.116.4:4938     , piece_id=IBQTNZIGJYQABGMDSI5WHYHOCNPJSOJZ6ZCBFSJ5VXUJTUL5HAXA, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.577323436 (44h26m4.930108535s) [noise=true , address=77.90.31.10:4517     , piece_id=R4C3RD7OSUE6TJXI4PVVN7YMI7MLXBUWINAUJFBV6M636OYJHJEQ, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.577508937 (44h26m4.930294045s) [noise=true , address=45.91.116.9:4262     , piece_id=LRM6GFKJ32VK7Z3JISIZZU6EFFXLXV42ANZVH5ACVTYG6ZGSZQ2A, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.577602001 (44h26m4.930387109s) [noise=true , address=77.90.31.13:4626     , piece_id=KM7RRKGD2KMIJS5HZYN5NG4PYFUONO3GMIO4YMDXV6IILQFR55FQ, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.577848836 (44h26m4.930633944s) [noise=true , address=104.36.82.8:4972     , piece_id=4P3VGACI7TRFNUITEA6PKDIJCNRC6IABG7VFJGQOVNHIPAU4JXVQ, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.578110889 (44h26m4.930895987s) [noise=true , address=45.91.116.13:4155    , piece_id=CARUNDCRDUI7AIKYQEYQAN5TPUUBYT35TS2B5JW4GQA7VBCUTVHQ, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.578403570 (44h26m4.931188668s) [noise=true , address=77.90.31.19:4841     , piece_id=FULOOTGMSGXXTPAVZRL5IGJ6PXJIDLFZKRIR6LO2IK334MYWLMFQ, seg_pos={0 0}, upload=39149]: Uploading piece...
Aug 31 10:34:29.659463754 (44h26m5.012248862s) [upload=39149]: Next returned nil segment
Aug 31 10:34:29.659471307 (44h26m5.012256415s) [upload=39149]: Waiting for error group managing segments...
Aug 31 10:34:29.677707370 (44h26m5.030492498s) [noise=true , address=104.36.82.8:4972     , piece_id=4P3VGACI7TRFNUITEA6PKDIJCNRC6IABG7VFJGQOVNHIPAU4JXVQ, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.678638423 (44h26m5.031423562s) [noise=true , address=104.36.82.5:4840     , piece_id=MBELIOT2GV75WHQRT7NDOOH4MC6TOTFWVYMKUQ3IEUE5Z4ITHUDQ, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.759227459 (44h26m5.112012567s) [noise=true , address=45.91.116.12:4225    , piece_id=RZQMHRRFC7AGQBOWTST7XA4VSJJMWYFQUEWKLTQPS7VCU7HYU3SA, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.759842086 (44h26m5.112627184s) [noise=true , address=45.91.116.11:4119    , piece_id=PNSXBR3VUSWMWKSBKAZBK3E2J4NWS2XTQUFQJHJUMNLOTVXE7UXQ, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.760569255 (44h26m5.113354353s) [noise=true , address=45.91.116.9:4262     , piece_id=LRM6GFKJ32VK7Z3JISIZZU6EFFXLXV42ANZVH5ACVTYG6ZGSZQ2A, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.764817573 (44h26m5.117602671s) [noise=true , address=45.91.116.13:4155    , piece_id=CARUNDCRDUI7AIKYQEYQAN5TPUUBYT35TS2B5JW4GQA7VBCUTVHQ, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.789537433 (44h26m5.142322531s) [noise=true , address=45.91.116.13:4154    , piece_id=SUCBVWPTTJA7DQ3YHMIYHXKLCPBZ7XMICT46RUKNGLRWPPNFQKMA, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.791692571 (44h26m5.144477669s) [noise=true , address=45.91.116.6:4975     , piece_id=KJ4I2Y23N7O57QTVMW5CTUM4NWJDQAXENHGE3HA7OZLSWEP7NYQA, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.793796762 (44h26m5.14658186s) [noise=true , address=45.91.116.5:4297     , piece_id=YWCTLPORKCZ7HALUS2GI4IFGTE3LB75FIG6XTG73TLTQXBST2JCQ, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.795827836 (44h26m5.148612935s) [noise=true , address=45.91.116.12:4227    , piece_id=VOYKGU7MXSETY2TG7RYXTVTTR24IATHZZYXD6HMJ3ZD7KLVX5S3Q, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:29.797709258 (44h26m5.150494356s) [noise=true , address=45.91.116.4:4938     , piece_id=IBQTNZIGJYQABGMDSI5WHYHOCNPJSOJZ6ZCBFSJ5VXUJTUL5HAXA, seg_pos={0 0}, upload=39149]: Done uploading piece. err: <nil>
Aug 31 10:34:59.536842588 (44h26m34.889627717s) [noise=true , address=77.90.31.10:4517     , piece_id=R4C3RD7OSUE6TJXI4PVVN7YMI7MLXBUWINAUJFBV6M636OYJHJEQ, seg_pos={0 0}, upload=39149]: Done uploading piece. err: ecclient: upload failed (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A, address:77.90.31.10:4517): protocol: write tcp 5.161.89.252:17086->77.90.31.10:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:59.536900687 (44h26m34.889685816s) [noise=true , address=77.90.31.19:4841     , piece_id=FULOOTGMSGXXTPAVZRL5IGJ6PXJIDLFZKRIR6LO2IK334MYWLMFQ, seg_pos={0 0}, upload=39149]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:59.536969959 (44h26m34.889755086s) [noise=true , address=77.90.31.15:4698     , piece_id=MUAYBTWDOH3K2OD5XRIXLZE6TPL5UQFGQCUA722PK3PL365K4MTA, seg_pos={0 0}, upload=39149]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:59.537071278 (44h26m34.889856406s) [noise=true , address=77.90.31.13:4626     , piece_id=KM7RRKGD2KMIJS5HZYN5NG4PYFUONO3GMIO4YMDXV6IILQFR55FQ, seg_pos={0 0}, upload=39149]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: rpc: dial tcp 77.90.31.13:4626: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Aug 31 10:34:59.537142814 (44h26m34.889927941s) [noise=true , address=77.90.31.13:4627     , piece_id=UNDQ2FFZPDE7LYBIITU3XDWZJFDM46LF23LTLCCQBTKXZOHOBJEA, seg_pos={0 0}, upload=39149]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 5.161.89.252:40810->77.90.31.13:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:59.537186406 (44h26m34.889971533s) [seg_pos={0 0}, upload=39149]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Aug 31 10:34:59.561712150 (44h26m34.914497278s) [upload=39149]: Done uploading segments...
Aug 31 10:34:59.561729442 (44h26m34.914514581s) [upload=39149]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 30.026292615s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
4.874713362s
FAIL (2025-08-31 10:34:59 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 4.874738138s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
4 out of 60 is failed (threshold=3) [......................................................XXXX..]
duration:
356.572222ms
FAIL (2025-08-31 10:34:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 356.676166ms edge gateway us-select-1
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)
antiblip:
7 out of 15 is failed (threshold=6) [..X..X.XXXX.X..]
duration:
93.091546ms
remote:
"tcp:54.243.86.28:443"
response headers:
Cache-Control=private
Vary=Accept-Encoding
Set-Cookie=_cfuvid=NjbuRdRySaJ4E5hyPkeg7M79z4AAUiRWP3COlrm1VlE-1756636399172-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Alt-Svc=h3=":443"; ma=86400
Date=Sun, 31 Aug 2025 10:33:19 GMT
Content-Type=text/html
Location=https://static.storj.io/dcs-satellites
X-Cluster-Name=us-east-1-prod-hosting-red
Content-Length=166
Cf-Ray=977bde768dbe81c7-IAD
Cf-Cache-Status=BYPASS
target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-31 10:34:54 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 93.123065ms core website
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
741.952275ms
FAIL (2025-08-31 10:34:54 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:62187->100.100.100.100:53: i/o timeout
Duration: 741.975871ms edge authservice http bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
176.4958ms
FAIL (2025-08-31 10:34:49 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 176.522108ms core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
53.905719ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-31 10:34:49 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:29236->100.100.100.100:53: i/o timeout
Duration: 53.930937ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
2.352324158s
FAIL (2025-08-31 10:34:47 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.352349867s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
199.349205ms
FAIL (2025-08-31 10:34:45 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 199.378281ms core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...]
duration:
134.284467ms
target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-08-31 10:34:41 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:51715->100.100.100.100:53: i/o timeout
Duration: 134.309725ms edge linksharing bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
661.602643ms
FAIL (2025-08-31 10:34:41 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:62187->100.100.100.100:53: i/o timeout
Duration: 661.625597ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
4 out of 60 is failed (threshold=3) [.......................................................XXXX.]
duration:
7.246741905s
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-08-31 10:34:39 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 7.246761964s edge linksharing us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
3 out of 60 is failed (threshold=3) [........................................................XXX.]
duration:
15.381489503s
FAIL (2025-08-31 10:34:38 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 15.381521594s edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)
antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...]
duration:
140.498247ms
FAIL (2025-08-31 10:34:38 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:62187->100.100.100.100:53: i/o timeout
Duration: 140.525538ms edge authservice http bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.......................................................XXXX.]
duration:
3.192231676s
FAIL (2025-08-31 10:34:37 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 3.192253287s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
4 out of 60 is failed (threshold=3) [.......................................................XXXX.]
duration:
28.967297ms
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-31 10:34:36 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 28.982165ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [........................................................XX..]
duration:
859.237322ms
FAIL (2025-08-31 10:34:30 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 859.259763ms core uplink eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.001072137s
FAIL (2025-08-31 10:34:30 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.001094108s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
177.5316ms
FAIL (2025-08-31 10:34:29 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 177.550426ms core uplink us1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
739.142289ms
target:
https://ap1.storj.io/login
FAIL (2025-08-31 10:34:25 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout
Duration: 739.168367ms core satellite ap1
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)
antiblip:
6 out of 15 is failed (threshold=6) [X.XX..X.X.X....]
duration:
58.78277ms
remote:
"tcp:54.243.86.28:443"
response headers:
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0
X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e
X-Cluster-Name=us-east-1-prod-hosting-red
Content-Type=text/html
Cf-Ray=977bdbb9bb4405a7-IAD
Surrogate-Control=max-age=2147483647
Vary=Accept-Encoding
Set-Cookie=_cfuvid=tDctWhkx4egbUPr6f_oo6I6IlUb.jNiAJYL2ctYUxHE-1756636287135-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None
Age=401172
Date=Sun, 31 Aug 2025 10:31:27 GMT
Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT
Alt-Svc=h3=":443"; ma=86400
Cf-Cache-Status=HIT
target:
https://www.storj.io/
FAIL (2025-08-31 10:34:22 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 58.809881ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.022926907s
FAIL (2025-08-31 10:34:21 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
Aug 31 10:33:51.626846706 (44h25m26.979631844s) [upload=39139]: Starting upload
Aug 31 10:33:51.626962945 (44h25m26.979748073s) [upload=39139]: Done starting upload
Aug 31 10:33:51.627070939 (44h25m26.979856077s) [upload=39139]: Uploading segments...
Aug 31 10:33:51.627643457 (44h25m26.980428585s) [upload=39139]: Got next segment. Inline: false
Aug 31 10:33:51.627716805 (44h25m26.980501944s) [upload=39139]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 31 10:33:51.627725561 (44h25m26.98051069s) [upload=39139]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 31 10:33:51.752705592 (44h25m27.10549072s) [seg_pos={0 0}, upload=39139]: Begin upload segment...
Aug 31 10:33:51.752739516 (44h25m27.105524644s) [seg_pos={0 0}, upload=39139]: Done begin upload segment.
Aug 31 10:33:51.752766156 (44h25m27.105551284s) [noise=true , address=104.36.82.5:4838     , piece_id=R6DTHLAXWZDAX34CXCEHAVSNE44DBVN6ZVZ7Z54BMXZIH6NKOLAQ, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.752839594 (44h25m27.105624713s) [noise=true , address=45.91.116.4:4939     , piece_id=GSAY7WTPIYHIAAUCAZSXHKHXPNKUHFIRAHGJYKLNFPSSF55BO2YA, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.753317584 (44h25m27.106102712s) [noise=true , address=45.91.116.12:4227    , piece_id=WMFPB26THL7KPZVWLAXIRBJ733TIAR2NUIU5BDEQWG4HORRKMHJQ, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.753713149 (44h25m27.106498277s) [noise=true , address=77.90.31.11:4555     , piece_id=A3XR4FC7GM4UNTE5FGA7Y7DHKTI45COUZZY45UM2ZVSLSEWWZL5A, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.753723158 (44h25m27.106508285s) [noise=true , address=77.90.31.10:4518     , piece_id=U7SHOQB2OBYF5HANYV3SVBMOQDQ5HN32EN6Z7TG3QU4U4B6JYLVA, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.754205837 (44h25m27.106990965s) [noise=true , address=45.91.116.13:4155    , piece_id=BBZW7VE42ZX32AJ6KZTIYORHR35KDLKC3LIYRCOX4TOR7HCGMGYQ, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.754559462 (44h25m27.107344591s) [noise=true , address=77.90.31.17:4770     , piece_id=OU2QR737EXBLJJOFRQZLPPGVESROXMKRNUJP3YJPL6XXW266NIZQ, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.754754509 (44h25m27.107539637s) [noise=true , address=77.90.31.14:4662     , piece_id=3PNB6LYIRSLIH7L7LBIVGSOEWUY3BMBYN4A32SKQOBCCM6MB23NA, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.755441192 (44h25m27.10822633s) [noise=true , address=77.90.31.16:4734     , piece_id=BUY4U6JAXIXAWSX3DX7NGZQS6LOZKHUEML76NVR4QLQZPXSS5W2Q, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.756548186 (44h25m27.109333314s) [noise=true , address=45.91.116.10:4083    , piece_id=ONBBWO53DKZOS5NTDL3AZOMS3IS2PUNIYYBVWR7NHLF3NSC3RK3Q, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.757145441 (44h25m27.109930569s) [noise=true , address=45.91.116.9:4262     , piece_id=PHAO4Q7JTK4IQ6R54XEMWBAHF43YQU32LVJOMTFWPCDN3E4W7OPA, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.757620335 (44h25m27.110405463s) [noise=true , address=45.91.116.8:4045     , piece_id=PGFG4BEBLAMA5UF5LHVNP74AHFVU74774SMTNSOX7JOKTQM5UXGA, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.758374836 (44h25m27.111159974s) [noise=true , address=77.90.31.18:4807     , piece_id=QO5QUHHYHKY722PFNZRCPZBNZXJXDYQGK6VXDVWLS7F5FAKWDXUA, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.758603115 (44h25m27.111388263s) [noise=true , address=77.90.31.15:4699     , piece_id=MJQ46XB3SY5K4DERKL6EPC5UYZJ32BQJCSMSKSI3JPQXHFJKVARQ, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.758991246 (44h25m27.111776374s) [noise=true , address=45.91.116.10:4081    , piece_id=2OWZRHIWVAVDP5VBCLPXVP3UAOQVUD5KPGUWB5TR5RVX3HVDC2LQ, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.759711682 (44h25m27.11249682s) [noise=true , address=45.91.116.5:4297     , piece_id=IZWVLZMFX3PTSKEELQYGG5D6RBQCPH732QFPUQXJNLX7SBETEDVQ, seg_pos={0 0}, upload=39139]: Uploading piece...
Aug 31 10:33:51.895355870 (44h25m27.248141008s) [upload=39139]: Next returned nil segment
Aug 31 10:33:51.895376669 (44h25m27.248161797s) [upload=39139]: Waiting for error group managing segments...
Aug 31 10:33:51.910024978 (44h25m27.262810087s) [noise=true , address=104.36.82.5:4838     , piece_id=R6DTHLAXWZDAX34CXCEHAVSNE44DBVN6ZVZ7Z54BMXZIH6NKOLAQ, seg_pos={0 0}, upload=39139]: Done uploading piece. err: <nil>
Aug 31 10:33:51.953980013 (44h25m27.30676511s) [noise=true , address=45.91.116.4:4939     , piece_id=GSAY7WTPIYHIAAUCAZSXHKHXPNKUHFIRAHGJYKLNFPSSF55BO2YA, seg_pos={0 0}, upload=39139]: Done uploading piece. err: <nil>
Aug 31 10:33:51.958402328 (44h25m27.311187457s) [noise=true , address=45.91.116.10:4083    , piece_id=ONBBWO53DKZOS5NTDL3AZOMS3IS2PUNIYYBVWR7NHLF3NSC3RK3Q, seg_pos={0 0}, upload=39139]: Done uploading piece. err: <nil>
Aug 31 10:33:51.959161858 (44h25m27.311946957s) [noise=true , address=45.91.116.9:4262     , piece_id=PHAO4Q7JTK4IQ6R54XEMWBAHF43YQU32LVJOMTFWPCDN3E4W7OPA, seg_pos={0 0}, upload=39139]: Done uploading piece. err: <nil>
Aug 31 10:33:51.961507915 (44h25m27.314293033s) [noise=true , address=45.91.116.5:4297     , piece_id=IZWVLZMFX3PTSKEELQYGG5D6RBQCPH732QFPUQXJNLX7SBETEDVQ, seg_pos={0 0}, upload=39139]: Done uploading piece. err: <nil>
Aug 31 10:33:51.971662132 (44h25m27.32444723s) [noise=true , address=45.91.116.10:4081    , piece_id=2OWZRHIWVAVDP5VBCLPXVP3UAOQVUD5KPGUWB5TR5RVX3HVDC2LQ, seg_pos={0 0}, upload=39139]: Done uploading piece. err: <nil>
Aug 31 10:33:51.980881200 (44h25m27.333666308s) [noise=true , address=45.91.116.13:4155    , piece_id=BBZW7VE42ZX32AJ6KZTIYORHR35KDLKC3LIYRCOX4TOR7HCGMGYQ, seg_pos={0 0}, upload=39139]: Done uploading piece. err: <nil>
Aug 31 10:33:51.982637216 (44h25m27.335422344s) [noise=true , address=45.91.116.8:4045     , piece_id=PGFG4BEBLAMA5UF5LHVNP74AHFVU74774SMTNSOX7JOKTQM5UXGA, seg_pos={0 0}, upload=39139]: Done uploading piece. err: <nil>
Aug 31 10:33:51.984714056 (44h25m27.337499174s) [noise=true , address=45.91.116.12:4227    , piece_id=WMFPB26THL7KPZVWLAXIRBJ733TIAR2NUIU5BDEQWG4HORRKMHJQ, seg_pos={0 0}, upload=39139]: Done uploading piece. err: <nil>
Aug 31 10:34:21.349949783 (44h25m56.702734891s) [noise=true , address=77.90.31.18:4807     , piece_id=QO5QUHHYHKY722PFNZRCPZBNZXJXDYQGK6VXDVWLS7F5FAKWDXUA, seg_pos={0 0}, upload=39139]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 5.161.89.252:55422->77.90.31.18:4807: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:21.350021207 (44h25m56.702806315s) [noise=true , address=77.90.31.17:4770     , piece_id=OU2QR737EXBLJJOFRQZLPPGVESROXMKRNUJP3YJPL6XXW266NIZQ, seg_pos={0 0}, upload=39139]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: write tcp 5.161.89.252:31090->77.90.31.17:4770: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:21.350065741 (44h25m56.702850849s) [noise=true , address=77.90.31.16:4734     , piece_id=BUY4U6JAXIXAWSX3DX7NGZQS6LOZKHUEML76NVR4QLQZPXSS5W2Q, seg_pos={0 0}, upload=39139]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: write tcp 5.161.89.252:63376->77.90.31.16:4734: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:21.350099965 (44h25m56.702885073s) [noise=true , address=77.90.31.11:4555     , piece_id=A3XR4FC7GM4UNTE5FGA7Y7DHKTI45COUZZY45UM2ZVSLSEWWZL5A, seg_pos={0 0}, upload=39139]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 5.161.89.252:32210->77.90.31.11:4555: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:21.350194784 (44h25m56.702979882s) [noise=true , address=77.90.31.10:4518     , piece_id=U7SHOQB2OBYF5HANYV3SVBMOQDQ5HN32EN6Z7TG3QU4U4B6JYLVA, seg_pos={0 0}, upload=39139]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 5.161.89.252:22886->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:21.350208280 (44h25m56.702993388s) [noise=true , address=77.90.31.15:4699     , piece_id=MJQ46XB3SY5K4DERKL6EPC5UYZJ32BQJCSMSKSI3JPQXHFJKVARQ, seg_pos={0 0}, upload=39139]: Done uploading piece. err: ecclient: upload failed (node:12Rb4DbV6syjrfdRBUUZQ4efA3xtwDFawUFp5GdQRc4GaDS2T8M, address:77.90.31.15:4699): protocol: write tcp 5.161.89.252:39030->77.90.31.15:4699: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:21.350292037 (44h25m56.703077135s) [noise=true , address=77.90.31.14:4662     , piece_id=3PNB6LYIRSLIH7L7LBIVGSOEWUY3BMBYN4A32SKQOBCCM6MB23NA, seg_pos={0 0}, upload=39139]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 5.161.89.252:26116->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:34:21.350313798 (44h25m56.703098906s) [seg_pos={0 0}, upload=39139]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Aug 31 10:34:21.368523652 (44h25m56.72130875s) [upload=39139]: Done uploading segments...
Aug 31 10:34:21.368552226 (44h25m56.721337324s) [upload=39139]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 30.022940082s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [........................................................XX..]
duration:
2.856230904s
FAIL (2025-08-31 10:34:21 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.856253907s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
2.206644294s
FAIL (2025-08-31 10:34:20 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 2.206671555s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
247.514835ms
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-31 10:34:16 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:29236->100.100.100.100:53: i/o timeout
Duration: 247.533983ms edge gateway vhost bgp ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration:
30.000886029s
FAIL (2025-08-31 10:34:13 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.000905827s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.000518228s
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-31 10:34:06 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 30.000542363s edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)
antiblip:
2 out of 60 is failed (threshold=3) [........................................................XX..]
duration:
276.958001ms
target:
https://eu1.storj.io/login
FAIL (2025-08-31 10:34:05 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 276.981784ms core satellite eu1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.000502859s
FAIL (2025-08-31 10:34:04 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 30.000525131s edge authservice http us-select-1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)
antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration:
30.001139386s
target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-08-31 10:34:01 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 30.001152872s edge linksharing us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
2.069053629s
FAIL (2025-08-31 10:33:58 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 2.069074108s core uplink ap1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
30.001399764s
FAIL (2025-08-31 10:33:56 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.00142385s edge gateway us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
687.653459ms
target:
https://ap1.storj.io/login
FAIL (2025-08-31 10:33:54 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout
Duration: 687.682685ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
841.855817ms
FAIL (2025-08-31 10:33:52 UTC)
orbiter warning: 
operation: StatBucket
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
Duration: 841.876626ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.]
duration:
2.289665548s
FAIL (2025-08-31 10:33:52 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
1 10:32:50.306443639 (44h24m25.659228737s) [noise=true , address=45.91.116.7:4019     , piece_id=T6FB5AYAES6F55VI2W2ZFBR6EKO556QCEO5QRW46KSSCYIEHQ4KA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.306689772 (44h24m25.659474871s) [noise=true , address=64.49.13.138:4482    , piece_id=N2S3XC277HSEMD6UPRHDQDD76RESNHSE6ZBNC3CCZHOFA7EEJTNA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.306723155 (44h24m25.659508253s) [noise=true , address=104.36.82.44:4898    , piece_id=CMQR4IZXD3Y25PKIRSXDO4E53VLLT2EVLER6OPQNJ6Y4CQS43MKA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.306938080 (44h24m25.659723188s) [noise=true , address=77.90.31.17:4801     , piece_id=WSWSL773IV2XI4UZI3SIMPH2L6KACQR4TWM2X55ZRYY3SQBFZ5NQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.306993555 (44h24m25.659778652s) [noise=true , address=104.36.82.23:4462    , piece_id=GGQQYG24VJ34UYKKL7ZVKEAI25YB7TSSN5G7E4ZLQMC722EACCMA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307186438 (44h24m25.659971546s) [noise=true , address=79.127.205.245:4245  , piece_id=OVUQKW5ZISJM2SNAMFYOFZA2N2JPBXNUBZDKXCT6V3NO3QKLV3IQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307269003 (44h24m25.660054101s) [noise=true , address=104.36.82.22:4531    , piece_id=G4ISIBBINGWF3LPM52EZGMQXSKNOYU5L4KK2PBWQWQQMCWPRNTCA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307493657 (44h24m25.660278765s) [noise=true , address=45.91.116.11:4127    , piece_id=66F5HBY2GHQ53RXGL4SSAPBWIW45ZFPFUMDKTOG2L6TMXZUN6WEQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307566443 (44h24m25.660351541s) [noise=true , address=77.90.31.21:4911     , piece_id=ED3OMS42IUGXLW34PTCN4A7VJYJH4LFRJIYYMBQKG2UAZVT5LMIA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307731533 (44h24m25.660516641s) [noise=true , address=77.90.31.19:4874     , piece_id=74LCB4NLAAQBH3X4YK5GUBBJT7OGTPFLCVUJR2PW5IO443MV2SUA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307854916 (44h24m25.660640014s) [noise=true , address=45.91.116.13:4176    , piece_id=BA4KMJDLKHWQ3EW5QA2MKOTD4KMAOGQBBE7FCPBJ232MV6WPKKDQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307991042 (44h24m25.660776141s) [noise=true , address=104.36.82.60:4362    , piece_id=LPVMR7RYANDXNSRPAXZAJVNXRG4ONLVR2AT7KP5TTA7D3LEQ677Q, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.308182263 (44h24m25.660967351s) [noise=true , address=104.36.82.48:4573    , piece_id=JYIGZUP2YLI6I4UMV2LLMKNMC4SPFOCFBFCPUDXFMPUNVRC5TY4Q, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.308225845 (44h24m25.661010953s) [noise=true , address=45.91.116.12:4230    , piece_id=37V7U5YYM4IERFZZWWIC2QEIF5PSE6K6OKPJGACPC3CBVKGFWFQQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.308475074 (44h24m25.661260172s) [noise=true , address=45.91.116.14:4205    , piece_id=RA367FBY26S3DZUUZUXNT4YSAKD7K3V26MT5HXTBLGNGZACW5PBA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.394111061 (44h24m25.746896159s) [upload=39123]: Next returned nil segment
Aug 31 10:32:50.394125748 (44h24m25.746910847s) [upload=39123]: Waiting for error group managing segments...
Aug 31 10:32:50.411207588 (44h24m25.763992686s) [noise=true , address=104.36.82.60:4362    , piece_id=LPVMR7RYANDXNSRPAXZAJVNXRG4ONLVR2AT7KP5TTA7D3LEQ677Q, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.448236003 (44h24m25.801021131s) [noise=true , address=104.36.82.23:4462    , piece_id=GGQQYG24VJ34UYKKL7ZVKEAI25YB7TSSN5G7E4ZLQMC722EACCMA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.458438521 (44h24m25.811223619s) [noise=true , address=104.36.82.48:4573    , piece_id=JYIGZUP2YLI6I4UMV2LLMKNMC4SPFOCFBFCPUDXFMPUNVRC5TY4Q, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.771585964 (44h24m26.124371092s) [noise=true , address=104.36.82.22:4531    , piece_id=G4ISIBBINGWF3LPM52EZGMQXSKNOYU5L4KK2PBWQWQQMCWPRNTCA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.772398374 (44h24m26.125183482s) [noise=true , address=104.36.82.44:4898    , piece_id=CMQR4IZXD3Y25PKIRSXDO4E53VLLT2EVLER6OPQNJ6Y4CQS43MKA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.790366894 (44h24m26.143152021s) [noise=true , address=79.127.205.245:4245  , piece_id=OVUQKW5ZISJM2SNAMFYOFZA2N2JPBXNUBZDKXCT6V3NO3QKLV3IQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.791800202 (44h24m26.14458531s) [noise=true , address=79.127.205.246:4277  , piece_id=7PHTDTJ7AFOYJALGYKJNINNWFJJ3EBZ3FNT73ZMWL2NNBZ57YN7Q, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.867073810 (44h24m26.219858938s) [noise=true , address=64.49.13.138:4482    , piece_id=N2S3XC277HSEMD6UPRHDQDD76RESNHSE6ZBNC3CCZHOFA7EEJTNA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:33:50.234487825 (44h25m25.587272963s) [noise=true , address=77.90.31.17:4801     , piece_id=WSWSL773IV2XI4UZI3SIMPH2L6KACQR4TWM2X55ZRYY3SQBFZ5NQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe, address:77.90.31.17:4801): protocol: write tcp 5.161.89.252:51390->77.90.31.17:4801: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234563819 (44h25m25.587348946s) [noise=true , address=45.91.116.14:4205    , piece_id=RA367FBY26S3DZUUZUXNT4YSAKD7K3V26MT5HXTBLGNGZACW5PBA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:12VfmooWvtic6UbcWtzBQ4ttYgUPbo8sjCJyM5VVCXgcQw6Ld6F, address:45.91.116.14:4205): protocol: rpc: dial tcp 45.91.116.14:4205: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234587693 (44h25m25.587372831s) [noise=true , address=77.90.31.21:4911     , piece_id=ED3OMS42IUGXLW34PTCN4A7VJYJH4LFRJIYYMBQKG2UAZVT5LMIA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf, address:77.90.31.21:4911): protocol: rpc: dial tcp 77.90.31.21:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234637937 (44h25m25.587423066s) [noise=true , address=45.91.116.7:4019     , piece_id=T6FB5AYAES6F55VI2W2ZFBR6EKO556QCEO5QRW46KSSCYIEHQ4KA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm, address:45.91.116.7:4019): protocol: write tcp 5.161.89.252:50450->45.91.116.7:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234651584 (44h25m25.587436712s) [noise=true , address=77.90.31.12:4601     , piece_id=ZZ6JP6HW4SQC4KPRADF4VOJE3HAD2B2UW7CG2HBZWQDLV4PTJ5TQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2, address:77.90.31.12:4601): protocol: write tcp 5.161.89.252:46324->77.90.31.12:4601: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234703391 (44h25m25.587488529s) [noise=true , address=45.91.116.13:4176    , piece_id=BA4KMJDLKHWQ3EW5QA2MKOTD4KMAOGQBBE7FCPBJ232MV6WPKKDQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: rpc: dial tcp 45.91.116.13:4176: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234712178 (44h25m25.587497306s) [noise=true , address=45.91.116.11:4127    , piece_id=66F5HBY2GHQ53RXGL4SSAPBWIW45ZFPFUMDKTOG2L6TMXZUN6WEQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:1MuGqtY6SnQrWgxJKjb15C6eLdKPbNijPHhH6D8sfrvhb6iKWG, address:45.91.116.11:4127): protocol: write tcp 5.161.89.252:10456->45.91.116.11:4127: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234766369 (44h25m25.587551497s) [noise=true , address=45.91.116.12:4230    , piece_id=37V7U5YYM4IERFZZWWIC2QEIF5PSE6K6OKPJGACPC3CBVKGFWFQQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:127RqMv3h2jS5V4nVqPmi3BDwT9gdJBC93EvyA8VXf5w77yiAQP, address:45.91.116.12:4230): protocol: write tcp 5.161.89.252:31230->45.91.116.12:4230: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234779023 (44h25m25.587564151s) [noise=true , address=45.91.116.9:4271     , piece_id=6VI5FZAJ43LROP36LSOBTYCFOUSYYFJZCBE6P24BCVC6BHZFO4UQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:1KNFPrpe7hiwp59iE8P3x2ciFAPAMh9ghZR9oziWSi7UMLkPnb, address:45.91.116.9:4271): protocol: rpc: dial tcp 45.91.116.9:4271: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234796356 (44h25m25.587581485s) [noise=true , address=77.90.31.19:4874     , piece_id=74LCB4NLAAQBH3X4YK5GUBBJT7OGTPFLCVUJR2PW5IO443MV2SUA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:14J8ruKPB6P9YBLPhHpCrcLJt3WBYwNo3fGBeJ2Pdp6JfWs3W4, address:77.90.31.19:4874): protocol: rpc: dial tcp 77.90.31.19:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234872028 (44h25m25.587657157s) [seg_pos={0 0}, upload=39123]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Aug 31 10:33:50.339511122 (44h25m25.69229625s) [upload=39123]: Done uploading segments...
Aug 31 10:33:50.339534155 (44h25m25.692319293s) [upload=39123]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 2.289681569s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.]
duration:
3.359572598s
FAIL (2025-08-31 10:33:52 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 3.359639975s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
1m0.10742701s
FAIL (2025-08-31 10:33:50 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
1 10:32:50.306443639 (44h24m25.659228737s) [noise=true , address=45.91.116.7:4019     , piece_id=T6FB5AYAES6F55VI2W2ZFBR6EKO556QCEO5QRW46KSSCYIEHQ4KA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.306689772 (44h24m25.659474871s) [noise=true , address=64.49.13.138:4482    , piece_id=N2S3XC277HSEMD6UPRHDQDD76RESNHSE6ZBNC3CCZHOFA7EEJTNA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.306723155 (44h24m25.659508253s) [noise=true , address=104.36.82.44:4898    , piece_id=CMQR4IZXD3Y25PKIRSXDO4E53VLLT2EVLER6OPQNJ6Y4CQS43MKA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.306938080 (44h24m25.659723188s) [noise=true , address=77.90.31.17:4801     , piece_id=WSWSL773IV2XI4UZI3SIMPH2L6KACQR4TWM2X55ZRYY3SQBFZ5NQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.306993555 (44h24m25.659778652s) [noise=true , address=104.36.82.23:4462    , piece_id=GGQQYG24VJ34UYKKL7ZVKEAI25YB7TSSN5G7E4ZLQMC722EACCMA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307186438 (44h24m25.659971546s) [noise=true , address=79.127.205.245:4245  , piece_id=OVUQKW5ZISJM2SNAMFYOFZA2N2JPBXNUBZDKXCT6V3NO3QKLV3IQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307269003 (44h24m25.660054101s) [noise=true , address=104.36.82.22:4531    , piece_id=G4ISIBBINGWF3LPM52EZGMQXSKNOYU5L4KK2PBWQWQQMCWPRNTCA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307493657 (44h24m25.660278765s) [noise=true , address=45.91.116.11:4127    , piece_id=66F5HBY2GHQ53RXGL4SSAPBWIW45ZFPFUMDKTOG2L6TMXZUN6WEQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307566443 (44h24m25.660351541s) [noise=true , address=77.90.31.21:4911     , piece_id=ED3OMS42IUGXLW34PTCN4A7VJYJH4LFRJIYYMBQKG2UAZVT5LMIA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307731533 (44h24m25.660516641s) [noise=true , address=77.90.31.19:4874     , piece_id=74LCB4NLAAQBH3X4YK5GUBBJT7OGTPFLCVUJR2PW5IO443MV2SUA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307854916 (44h24m25.660640014s) [noise=true , address=45.91.116.13:4176    , piece_id=BA4KMJDLKHWQ3EW5QA2MKOTD4KMAOGQBBE7FCPBJ232MV6WPKKDQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.307991042 (44h24m25.660776141s) [noise=true , address=104.36.82.60:4362    , piece_id=LPVMR7RYANDXNSRPAXZAJVNXRG4ONLVR2AT7KP5TTA7D3LEQ677Q, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.308182263 (44h24m25.660967351s) [noise=true , address=104.36.82.48:4573    , piece_id=JYIGZUP2YLI6I4UMV2LLMKNMC4SPFOCFBFCPUDXFMPUNVRC5TY4Q, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.308225845 (44h24m25.661010953s) [noise=true , address=45.91.116.12:4230    , piece_id=37V7U5YYM4IERFZZWWIC2QEIF5PSE6K6OKPJGACPC3CBVKGFWFQQ, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.308475074 (44h24m25.661260172s) [noise=true , address=45.91.116.14:4205    , piece_id=RA367FBY26S3DZUUZUXNT4YSAKD7K3V26MT5HXTBLGNGZACW5PBA, seg_pos={0 0}, upload=39123]: Uploading piece...
Aug 31 10:32:50.394111061 (44h24m25.746896159s) [upload=39123]: Next returned nil segment
Aug 31 10:32:50.394125748 (44h24m25.746910847s) [upload=39123]: Waiting for error group managing segments...
Aug 31 10:32:50.411207588 (44h24m25.763992686s) [noise=true , address=104.36.82.60:4362    , piece_id=LPVMR7RYANDXNSRPAXZAJVNXRG4ONLVR2AT7KP5TTA7D3LEQ677Q, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.448236003 (44h24m25.801021131s) [noise=true , address=104.36.82.23:4462    , piece_id=GGQQYG24VJ34UYKKL7ZVKEAI25YB7TSSN5G7E4ZLQMC722EACCMA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.458438521 (44h24m25.811223619s) [noise=true , address=104.36.82.48:4573    , piece_id=JYIGZUP2YLI6I4UMV2LLMKNMC4SPFOCFBFCPUDXFMPUNVRC5TY4Q, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.771585964 (44h24m26.124371092s) [noise=true , address=104.36.82.22:4531    , piece_id=G4ISIBBINGWF3LPM52EZGMQXSKNOYU5L4KK2PBWQWQQMCWPRNTCA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.772398374 (44h24m26.125183482s) [noise=true , address=104.36.82.44:4898    , piece_id=CMQR4IZXD3Y25PKIRSXDO4E53VLLT2EVLER6OPQNJ6Y4CQS43MKA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.790366894 (44h24m26.143152021s) [noise=true , address=79.127.205.245:4245  , piece_id=OVUQKW5ZISJM2SNAMFYOFZA2N2JPBXNUBZDKXCT6V3NO3QKLV3IQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.791800202 (44h24m26.14458531s) [noise=true , address=79.127.205.246:4277  , piece_id=7PHTDTJ7AFOYJALGYKJNINNWFJJ3EBZ3FNT73ZMWL2NNBZ57YN7Q, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:32:50.867073810 (44h24m26.219858938s) [noise=true , address=64.49.13.138:4482    , piece_id=N2S3XC277HSEMD6UPRHDQDD76RESNHSE6ZBNC3CCZHOFA7EEJTNA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: <nil>
Aug 31 10:33:50.234487825 (44h25m25.587272963s) [noise=true , address=77.90.31.17:4801     , piece_id=WSWSL773IV2XI4UZI3SIMPH2L6KACQR4TWM2X55ZRYY3SQBFZ5NQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:127QRLNwZLcR5gnAgZrCjSUsH5T4jESmZ4kWeAnpj9YxaTSjoYe, address:77.90.31.17:4801): protocol: write tcp 5.161.89.252:51390->77.90.31.17:4801: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234563819 (44h25m25.587348946s) [noise=true , address=45.91.116.14:4205    , piece_id=RA367FBY26S3DZUUZUXNT4YSAKD7K3V26MT5HXTBLGNGZACW5PBA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:12VfmooWvtic6UbcWtzBQ4ttYgUPbo8sjCJyM5VVCXgcQw6Ld6F, address:45.91.116.14:4205): protocol: rpc: dial tcp 45.91.116.14:4205: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234587693 (44h25m25.587372831s) [noise=true , address=77.90.31.21:4911     , piece_id=ED3OMS42IUGXLW34PTCN4A7VJYJH4LFRJIYYMBQKG2UAZVT5LMIA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:1cxBiYLx8eWayRmXGXzNyRKAMLEcL7gJ7VU4wLvKhN2nCQbqwf, address:77.90.31.21:4911): protocol: rpc: dial tcp 77.90.31.21:4911: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234637937 (44h25m25.587423066s) [noise=true , address=45.91.116.7:4019     , piece_id=T6FB5AYAES6F55VI2W2ZFBR6EKO556QCEO5QRW46KSSCYIEHQ4KA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:128Sx7BgHeTbxPF76pcRzJtHZKcWiYaboxcnkadhVLvs5AHYzFm, address:45.91.116.7:4019): protocol: write tcp 5.161.89.252:50450->45.91.116.7:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234651584 (44h25m25.587436712s) [noise=true , address=77.90.31.12:4601     , piece_id=ZZ6JP6HW4SQC4KPRADF4VOJE3HAD2B2UW7CG2HBZWQDLV4PTJ5TQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:12pQPpDBX1nYAGc961a72T8NyFRc8yLMKfvYBqwuNBYQetzQZL2, address:77.90.31.12:4601): protocol: write tcp 5.161.89.252:46324->77.90.31.12:4601: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234703391 (44h25m25.587488529s) [noise=true , address=45.91.116.13:4176    , piece_id=BA4KMJDLKHWQ3EW5QA2MKOTD4KMAOGQBBE7FCPBJ232MV6WPKKDQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: rpc: dial tcp 45.91.116.13:4176: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234712178 (44h25m25.587497306s) [noise=true , address=45.91.116.11:4127    , piece_id=66F5HBY2GHQ53RXGL4SSAPBWIW45ZFPFUMDKTOG2L6TMXZUN6WEQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:1MuGqtY6SnQrWgxJKjb15C6eLdKPbNijPHhH6D8sfrvhb6iKWG, address:45.91.116.11:4127): protocol: write tcp 5.161.89.252:10456->45.91.116.11:4127: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234766369 (44h25m25.587551497s) [noise=true , address=45.91.116.12:4230    , piece_id=37V7U5YYM4IERFZZWWIC2QEIF5PSE6K6OKPJGACPC3CBVKGFWFQQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:127RqMv3h2jS5V4nVqPmi3BDwT9gdJBC93EvyA8VXf5w77yiAQP, address:45.91.116.12:4230): protocol: write tcp 5.161.89.252:31230->45.91.116.12:4230: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234779023 (44h25m25.587564151s) [noise=true , address=45.91.116.9:4271     , piece_id=6VI5FZAJ43LROP36LSOBTYCFOUSYYFJZCBE6P24BCVC6BHZFO4UQ, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:1KNFPrpe7hiwp59iE8P3x2ciFAPAMh9ghZR9oziWSi7UMLkPnb, address:45.91.116.9:4271): protocol: rpc: dial tcp 45.91.116.9:4271: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234796356 (44h25m25.587581485s) [noise=true , address=77.90.31.19:4874     , piece_id=74LCB4NLAAQBH3X4YK5GUBBJT7OGTPFLCVUJR2PW5IO443MV2SUA, seg_pos={0 0}, upload=39123]: Done uploading piece. err: ecclient: upload failed (node:14J8ruKPB6P9YBLPhHpCrcLJt3WBYwNo3fGBeJ2Pdp6JfWs3W4, address:77.90.31.19:4874): protocol: rpc: dial tcp 77.90.31.19:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:50.234872028 (44h25m25.587657157s) [seg_pos={0 0}, upload=39123]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Aug 31 10:33:50.339511122 (44h25m25.69229625s) [upload=39123]: Done uploading segments...
Aug 31 10:33:50.339534155 (44h25m25.692319293s) [upload=39123]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 1m0.107442269s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
772.007074ms
FAIL (2025-08-31 10:33:48 UTC)
orbiter warning: operation: StatBucket
uplink: bucket: metaclient: context deadline exceeded
Duration: 772.030548ms core uplink us1