Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.721123265s
FAIL (2025-08-31 10:33:48 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 2.721185973s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
7 out of 15 is failed (threshold=6) [...X..X.XXXX.X.] duration:
150.960233ms remote:
"tcp:54.243.86.28:443" response headers:
Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=NjbuRdRySaJ4E5hyPkeg7M79z4AAUiRWP3COlrm1VlE-1756636399172-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Date=Sun, 31 Aug 2025 10:33:19 GMT Content-Type=text/html Location=https://static.storj.io/dcs-satellites X-Cluster-Name=us-east-1-prod-hosting-red Content-Length=166 Cf-Ray=977bde768dbe81c7-IAD Cf-Cache-Status=BYPASS target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-31 10:33:46 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 151.013655ms
core
website
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [........................................................XX..] duration:
168.153673ms
FAIL (2025-08-31 10:33:46 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:62187->100.100.100.100:53: i/o timeout
Duration: 168.177169ms
edge
authservice
http
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
50.423299905s
FAIL (2025-08-31 10:33:45 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 50.423318299s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.903573118s
FAIL (2025-08-31 10:33:45 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.903596851s
core
uplink
ap1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
962.509483ms
FAIL (2025-08-31 10:33:39 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:62187->100.100.100.100:53: i/o timeout
Duration: 962.529411ms
edge
authservice
http
bgp
ap1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
301.911782ms target:
https://eu1.storj.io/login
FAIL (2025-08-31 10:33:38 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 301.944743ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
43.959923ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-31 10:33:36 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:29236->100.100.100.100:53: i/o timeout
Duration: 43.988226ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
7 out of 15 is failed (threshold=6) [XX.XX..X.X.X...] duration:
54.37331ms remote:
"tcp:54.243.86.28:443" response headers:
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e X-Cluster-Name=us-east-1-prod-hosting-red Content-Type=text/html Cf-Ray=977bdbb9bb4405a7-IAD Surrogate-Control=max-age=2147483647 Vary=Accept-Encoding Set-Cookie=_cfuvid=tDctWhkx4egbUPr6f_oo6I6IlUb.jNiAJYL2ctYUxHE-1756636287135-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Age=401172 Date=Sun, 31 Aug 2025 10:31:27 GMT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Alt-Svc=h3=":443"; ma=86400 Cf-Cache-Status=HIT target:
https://www.storj.io/
FAIL (2025-08-31 10:33:35 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 54.398326ms
core
website
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.000562332s
FAIL (2025-08-31 10:33:33 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 30.00057804s
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
1.018316631s
FAIL (2025-08-31 10:33:32 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.018337421s
core
uplink
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
675.664157ms
FAIL (2025-08-31 10:33:32 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:62187->100.100.100.100:53: i/o timeout
Duration: 675.700625ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
118.535266ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-08-31 10:33:31 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:51715->100.100.100.100:53: i/o timeout
Duration: 118.576204ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
249.195362ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-31 10:33:28 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:29236->100.100.100.100:53: i/o timeout
Duration: 249.22043ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.059175732s
FAIL (2025-08-31 10:33:27 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.059201161s
core
uplink
ap1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX] duration:
30.001047533s target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-08-31 10:33:27 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 30.001063994s
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.000713073s target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-31 10:33:27 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 30.000728452s
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.001114618s
FAIL (2025-08-31 10:33:26 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001130168s
core
uplink
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
4.877719036s
FAIL (2025-08-31 10:33:25 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.877752479s
core
uplink
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX] duration:
30.00019705s
FAIL (2025-08-31 10:33:24 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.000212322s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.000659375s target:
https://eu1.storj.io/login
FAIL (2025-08-31 10:33:23 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 30.000684832s
core
satellite
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000929714s
FAIL (2025-08-31 10:33:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 30.000952567s
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
8 out of 15 is failed (threshold=6) [X...X..X.XXXX.X] duration:
59.704368ms remote:
"tcp:54.243.86.28:443" response headers:
Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=NjbuRdRySaJ4E5hyPkeg7M79z4AAUiRWP3COlrm1VlE-1756636399172-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 Date=Sun, 31 Aug 2025 10:33:19 GMT Content-Type=text/html Location=https://static.storj.io/dcs-satellites X-Cluster-Name=us-east-1-prod-hosting-red Content-Length=166 Cf-Ray=977bde768dbe81c7-IAD Cf-Cache-Status=BYPASS target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-31 10:33:19 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 59.7274ms
core
website
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
736.868275ms
FAIL (2025-08-31 10:33:16 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 736.89244ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
285.32297ms
FAIL (2025-08-31 10:33:16 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 285.344782ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
175.220609ms target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-08-31 10:33:12 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:51715->100.100.100.100:53: i/o timeout
Duration: 175.245475ms
edge
linksharing
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777"} failure (antiblip window 3/60): (authservice.ap1)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
819.665149ms
FAIL (2025-08-31 10:33:11 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:62187->100.100.100.100:53: i/o timeout
Duration: 819.690525ms
edge
authservice
http
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.000359339s
FAIL (2025-08-31 10:33:09 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.000377623s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.024453841s
FAIL (2025-08-31 10:33:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 4)
======LOGS======
ess=45.91.116.13:4154 , piece_id=3CRJFYKKB7HTEMZGUJZLXDSJDJ5XOM3SCHRZGNSPKAHSWQO4DY5Q, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.844619601 (44h24m13.197404699s) [noise=true , address=45.91.116.10:4082 , piece_id=7OWHUHAZXFWAEHE67K6ICAIXBAM2SBSWDKWZVGW76MN2FOTVCTZA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.844875272 (44h24m13.197660371s) [noise=true , address=45.91.116.14:4191 , piece_id=EDFIIJJ6ZW27LUCSJPFR2X7AHMYV5XV4CYDQL2ITAS4NMS7OCM4Q, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.844972106 (44h24m13.197757203s) [noise=true , address=45.91.116.4:4940 , piece_id=6RHQFNIZAAX6QYHSQ3IC5EES4QL5KSUGSLJUCUGAZDGP6BYTCXKQ, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.845137106 (44h24m13.197922214s) [noise=true , address=104.36.82.7:4911 , piece_id=46NTR6NTWL7PYZ5CTZ75MSZSJAH3RFLUD2W7ROZNOO7QVHHPKKNA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.845239168 (44h24m13.198024277s) [noise=true , address=104.36.82.8:4969 , piece_id=IVKW6Q5H5VQ2XSGGFZ6SFWZSPCSRYIPD2GQLZBI6RMT4VKMP7KHQ, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.845431359 (44h24m13.198216467s) [noise=true , address=104.36.82.9:4005 , piece_id=HXCOEWVJOS44IL52R4IXAQE4IPE7MIPGY42FGD7IC4ID7Y3GJYFA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.845626939 (44h24m13.198412047s) [noise=true , address=45.91.116.5:4299 , piece_id=DVS452UYKAT6FLGQZFYSL5MCDWE33G62COYSTNOBTG7Z6DOE3USA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.845668657 (44h24m13.198453765s) [noise=true , address=77.90.31.16:4735 , piece_id=UTOR234EGGMSLYQSMUHGWREZTBAWITDG7YEXD22UP7Q7ZG5KVOZA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.845992627 (44h24m13.198777724s) [noise=true , address=45.91.116.11:4117 , piece_id=TUML2DIF2ECRRLKDK4CUYD6O3FMWFCRXAOKRRPXLGBGGI4MNQ7WA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.846022232 (44h24m13.198807341s) [noise=true , address=77.90.31.12:4592 , piece_id=A2W35ZHVPSZ4SLRFQQZBQDIC6QE5HKKA5NDFCHRXHJF4VA7RGHTQ, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.846217811 (44h24m13.199002919s) [noise=true , address=45.91.116.9:4261 , piece_id=6TCAHGWZOTKIHJEZDIPL6DMJSTKSD3BU7HEUTFA7FKEY4TDH67QA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.846327958 (44h24m13.199113066s) [noise=true , address=45.91.116.12:4226 , piece_id=MYKAE7CXC7VVS5VEUIKC22APGIJOXEGSAH7OWYDVPICMR6DD6ABA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.846497637 (44h24m13.199282736s) [noise=true , address=104.36.82.15:4258 , piece_id=D3W2Q4YUEUAWVHW7XTLTNRU75PBBA6CDSFN2XK5YY5DYIVDRFJWA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.846716339 (44h24m13.199501447s) [noise=true , address=77.90.31.18:4806 , piece_id=TSP44NIAXR65XGA3W267ZUAPYCBCFFM6GPSYT5R5A2EBEECUSUFQ, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.846722030 (44h24m13.199507138s) [noise=true , address=45.91.116.6:4975 , piece_id=LPU7MMWU237MZMQPITJX6VXHS34JEWJW2WLL6QX7QPUP7YUZCPUA, seg_pos={0 0}, upload=39122]: Uploading piece...
Aug 31 10:32:37.982362492 (44h24m13.335147589s) [upload=39122]: Next returned nil segment
Aug 31 10:32:37.982379904 (44h24m13.335165012s) [upload=39122]: Waiting for error group managing segments...
Aug 31 10:32:38.003575309 (44h24m13.356360427s) [noise=true , address=104.36.82.7:4911 , piece_id=46NTR6NTWL7PYZ5CTZ75MSZSJAH3RFLUD2W7ROZNOO7QVHHPKKNA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: <nil>
Aug 31 10:32:38.004468831 (44h24m13.357253929s) [noise=true , address=104.36.82.8:4969 , piece_id=IVKW6Q5H5VQ2XSGGFZ6SFWZSPCSRYIPD2GQLZBI6RMT4VKMP7KHQ, seg_pos={0 0}, upload=39122]: Done uploading piece. err: <nil>
Aug 31 10:32:38.072374257 (44h24m13.425159386s) [noise=true , address=104.36.82.15:4258 , piece_id=D3W2Q4YUEUAWVHW7XTLTNRU75PBBA6CDSFN2XK5YY5DYIVDRFJWA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: <nil>
Aug 31 10:32:38.206874312 (44h24m13.55965941s) [noise=true , address=104.36.82.9:4005 , piece_id=HXCOEWVJOS44IL52R4IXAQE4IPE7MIPGY42FGD7IC4ID7Y3GJYFA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: <nil>
Aug 31 10:33:07.777169906 (44h24m43.129955025s) [noise=true , address=45.91.116.14:4191 , piece_id=EDFIIJJ6ZW27LUCSJPFR2X7AHMYV5XV4CYDQL2ITAS4NMS7OCM4Q, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777230881 (44h24m43.130015989s) [noise=true , address=45.91.116.5:4299 , piece_id=DVS452UYKAT6FLGQZFYSL5MCDWE33G62COYSTNOBTG7Z6DOE3USA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777298278 (44h24m43.130083386s) [noise=true , address=77.90.31.12:4592 , piece_id=A2W35ZHVPSZ4SLRFQQZBQDIC6QE5HKKA5NDFCHRXHJF4VA7RGHTQ, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: rpc: dial tcp 77.90.31.12:4592: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777336470 (44h24m43.130121588s) [noise=true , address=45.91.116.9:4261 , piece_id=6TCAHGWZOTKIHJEZDIPL6DMJSTKSD3BU7HEUTFA7FKEY4TDH67QA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: rpc: dial tcp 45.91.116.9:4261: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777373259 (44h24m43.130158377s) [noise=true , address=45.91.116.12:4226 , piece_id=MYKAE7CXC7VVS5VEUIKC22APGIJOXEGSAH7OWYDVPICMR6DD6ABA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: rpc: dial tcp 45.91.116.12:4226: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777399508 (44h24m43.130184626s) [noise=true , address=45.91.116.10:4082 , piece_id=7OWHUHAZXFWAEHE67K6ICAIXBAM2SBSWDKWZVGW76MN2FOTVCTZA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj, address:45.91.116.10:4082): protocol: rpc: dial tcp 45.91.116.10:4082: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777523611 (44h24m43.13030874s) [noise=true , address=45.91.116.13:4154 , piece_id=3CRJFYKKB7HTEMZGUJZLXDSJDJ5XOM3SCHRZGNSPKAHSWQO4DY5Q, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN, address:45.91.116.13:4154): protocol: rpc: dial tcp 45.91.116.13:4154: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777594125 (44h24m43.130379253s) [noise=true , address=45.91.116.6:4975 , piece_id=LPU7MMWU237MZMQPITJX6VXHS34JEWJW2WLL6QX7QPUP7YUZCPUA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:12oUsZAf26PYH66pEfjgF9ydtxCoUYspEcsrSRmdhC63woA1hf7, address:45.91.116.6:4975): protocol: rpc: dial tcp 45.91.116.6:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777614954 (44h24m43.130400072s) [noise=true , address=77.90.31.18:4806 , piece_id=TSP44NIAXR65XGA3W267ZUAPYCBCFFM6GPSYT5R5A2EBEECUSUFQ, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: rpc: dial tcp 77.90.31.18:4806: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777647605 (44h24m43.130432733s) [noise=true , address=45.91.116.4:4940 , piece_id=6RHQFNIZAAX6QYHSQ3IC5EES4QL5KSUGSLJUCUGAZDGP6BYTCXKQ, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: rpc: dial tcp 45.91.116.4:4940: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777674686 (44h24m43.130459804s) [noise=true , address=77.90.31.16:4735 , piece_id=UTOR234EGGMSLYQSMUHGWREZTBAWITDG7YEXD22UP7Q7ZG5KVOZA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h, address:77.90.31.16:4735): protocol: rpc: dial tcp 77.90.31.16:4735: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777702720 (44h24m43.130487848s) [noise=true , address=45.91.116.11:4117 , piece_id=TUML2DIF2ECRRLKDK4CUYD6O3FMWFCRXAOKRRPXLGBGGI4MNQ7WA, seg_pos={0 0}, upload=39122]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 5.161.89.252:52726->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:33:07.777740380 (44h24m43.130525508s) [seg_pos={0 0}, upload=39122]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil>
Aug 31 10:33:07.799502492 (44h24m43.15228762s) [upload=39122]: Done uploading segments...
Aug 31 10:33:07.799525094 (44h24m43.152310222s) [upload=39122]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4)
Duration: 30.024475092s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
622.800239ms
FAIL (2025-08-31 10:33:07 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:62187->100.100.100.100:53: i/o timeout
Duration: 622.817411ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://www.storj.io/"} failure (antiblip window 6/15): (http.www_storj_io)antiblip:
8 out of 15 is failed (threshold=6) [XXX.XX..X.X.X..] duration:
58.621114ms remote:
"tcp:54.243.86.28:443" response headers:
Surrogate-Key=www.storj.io 65d78d3b8dbb1f54a94020c7 pageId:67eb0cf63d37c62ac04e0ff0 X-Lambda-Id=c6207948-cc73-40b2-9a2a-e948767f3d5e X-Cluster-Name=us-east-1-prod-hosting-red Content-Type=text/html Cf-Ray=977bdbb9bb4405a7-IAD Surrogate-Control=max-age=2147483647 Vary=Accept-Encoding Set-Cookie=_cfuvid=tDctWhkx4egbUPr6f_oo6I6IlUb.jNiAJYL2ctYUxHE-1756636287135-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Age=401172 Date=Sun, 31 Aug 2025 10:31:27 GMT Last-Modified=Tue, 26 Aug 2025 19:05:15 GMT Alt-Svc=h3=":443"; ma=86400 Cf-Cache-Status=HIT target:
https://www.storj.io/
FAIL (2025-08-31 10:33:06 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 58.641331ms
core
website
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us1)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
178.28708ms
FAIL (2025-08-31 10:33:04 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:62187->100.100.100.100:53: i/o timeout
Duration: 178.307518ms
edge
authservice
http
bgp
us1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001199078s
FAIL (2025-08-31 10:33:03 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": dial tcp 45.38.24.2:443: i/o timeout
Duration: 30.001219315s
edge
authservice
http
us-select-1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
833.130799ms target:
https://ap1.storj.io/login
FAIL (2025-08-31 10:33:00 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout
Duration: 833.155004ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.099288581s
FAIL (2025-08-31 10:32:58 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.099304401s
core
uplink
ap1
|
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.000663775s target:
http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt
FAIL (2025-08-31 10:32:57 UTC)
orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp 45.38.24.2:80: i/o timeout
Duration: 30.000681648s
edge
linksharing
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001562246s target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
FAIL (2025-08-31 10:32:57 UTC)
orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": dial tcp 45.38.24.2:443: i/o timeout
Duration: 30.001643819s
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
439.8141ms
FAIL (2025-08-31 10:32:54 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 439.837845ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.001257919s
FAIL (2025-08-31 10:32:54 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1m0.001278579s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.000556002s
FAIL (2025-08-31 10:32:53 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded
Duration: 30.00056627s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.024008586s
FAIL (2025-08-31 10:32:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
9121]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 31 10:32:37.665781041 (44h24m13.018566139s) [upload=39121]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 31 10:32:37.698230896 (44h24m13.051015994s) [seg_pos={0 0}, upload=39121]: Begin upload segment...
Aug 31 10:32:37.698282543 (44h24m13.051067641s) [seg_pos={0 0}, upload=39121]: Done begin upload segment.
Aug 31 10:32:37.698302692 (44h24m13.0510878s) [noise=true , address=104.36.82.55:4224 , piece_id=FODREWQLIO7RKOMKPXHBAQPSHYHVGTT4FE7EZVM6EA6TJANX2FIQ, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.698312039 (44h24m13.051097147s) [noise=true , address=77.90.31.15:4712 , piece_id=24XA26WS36ZQACFBP2GLOFW36QT7PIGUDUBYPHKKCRFWLRXHW3VA, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.698589461 (44h24m13.051374569s) [noise=true , address=104.36.82.6:4907 , piece_id=R5ZFAQG4OIQ7K27AIYDUJCVU6EOLT2CBQZFVPI5GSVTAQTPOWWBA, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.698838940 (44h24m13.051624048s) [noise=true , address=104.36.82.23:4466 , piece_id=Q7AJOUKVFA5QX2RBN6W75TMWBPZQ3QX5JVBRTYFFYRRKY5ENJCCQ, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.699061269 (44h24m13.051846377s) [noise=true , address=45.91.116.11:4128 , piece_id=FLJ6NZETQQ6HZJDMMSZVFBT3N6ZJIMBZMOBOYJPJUUJ3JPLIE2CA, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.699284760 (44h24m13.052069868s) [noise=true , address=45.91.116.12:4250 , piece_id=47BV4FLTJ2S3HDCVQW4MAHLY6AKXP5AHBAQ2ITH5N2IGGWV4OYXQ, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.699491820 (44h24m13.052276918s) [noise=true , address=79.127.205.245:4246 , piece_id=CQMP3UTW6XYUXALZQ3STEF5GSYS5EOALFQARTFUSFVS5VQXDIK3A, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.699698088 (44h24m13.052483187s) [noise=true , address=79.127.205.246:4278 , piece_id=HIJ335H7NKGXPPUIVVWJT6QFOZBZ25VWFJZCX52JYHENIYNMD3KA, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.699944943 (44h24m13.05273004s) [noise=true , address=104.36.82.5:4857 , piece_id=YBN5CJPKBUDOVC4GIJAJH5FWRY3BP26VD5KHMYOMMPJ2R7DXNGWQ, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.700157884 (44h24m13.052942992s) [noise=true , address=45.91.116.13:4176 , piece_id=GIY3ZW54DQGYQA7L3OEWAQGQOV26MMEVXPO7BGFXRXPPWAXYV2HQ, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.700378668 (44h24m13.053163777s) [noise=true , address=104.36.82.49:4983 , piece_id=GUUO53J6PQKA4OOJFVPQ4L5XTLKV4ZJQHJKNHSSLDIZZW7YNS5XA, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.700580269 (44h24m13.053365377s) [noise=true , address=77.90.31.14:4679 , piece_id=3OD5GGY27JNPKRAJZ7CQXSKOJQV24IMSHXPCRAX4VLFMM45X6L3Q, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.700805703 (44h24m13.053590811s) [noise=true , address=64.49.13.138:4483 , piece_id=BKT6YGXJQLAKEXL5WEU6TMKETCHM2NVSNZN5CX2PLGKKGKEWYDWQ, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.701016349 (44h24m13.053801458s) [noise=true , address=104.36.82.52:4093 , piece_id=SDUJYNEYB77OBKQWFQ5KTXKQMH7VD2VWOMCCHXNGDS4OGQUTYLPQ, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.701215474 (44h24m13.054000582s) [noise=true , address=104.36.82.44:4878 , piece_id=MCOVV7FA6IDRFXQDJWSOHOVPBVZLENKRU4CBZ2T3Q5WBXPA4U5NA, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.701433896 (44h24m13.054218994s) [noise=true , address=77.90.31.17:4793 , piece_id=VECKC27HBUMBIJYLG5PWQDH6XYBM3A3VOGE2OUB4UA2V2IBFVZXQ, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.701638852 (44h24m13.054423949s) [noise=true , address=104.36.82.48:4579 , piece_id=NOGP3EZILN75MR5LZ6AGKXBCP3CPGQR2EXAZX54LIEKPNALRNTUQ, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.701859817 (44h24m13.054644925s) [noise=true , address=104.36.82.21:4474 , piece_id=P53IAI2VPZNFODNEV2JZSWIKD3CTIP2GDZCY4EIQ33QU65S72PJA, seg_pos={0 0}, upload=39121]: Uploading piece...
Aug 31 10:32:37.822502181 (44h24m13.175287289s) [upload=39121]: Next returned nil segment
Aug 31 10:32:37.822509144 (44h24m13.175294242s) [upload=39121]: Waiting for error group managing segments...
Aug 31 10:32:37.859163925 (44h24m13.211949023s) [noise=true , address=104.36.82.55:4224 , piece_id=FODREWQLIO7RKOMKPXHBAQPSHYHVGTT4FE7EZVM6EA6TJANX2FIQ, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:37.862133846 (44h24m13.214918944s) [noise=true , address=104.36.82.21:4474 , piece_id=P53IAI2VPZNFODNEV2JZSWIKD3CTIP2GDZCY4EIQ33QU65S72PJA, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:37.864555235 (44h24m13.217340334s) [noise=true , address=104.36.82.49:4983 , piece_id=GUUO53J6PQKA4OOJFVPQ4L5XTLKV4ZJQHJKNHSSLDIZZW7YNS5XA, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:38.031857566 (44h24m13.384642665s) [noise=true , address=104.36.82.5:4857 , piece_id=YBN5CJPKBUDOVC4GIJAJH5FWRY3BP26VD5KHMYOMMPJ2R7DXNGWQ, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:38.037397427 (44h24m13.390182535s) [noise=true , address=104.36.82.48:4579 , piece_id=NOGP3EZILN75MR5LZ6AGKXBCP3CPGQR2EXAZX54LIEKPNALRNTUQ, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:38.037900703 (44h24m13.390685811s) [noise=true , address=104.36.82.52:4093 , piece_id=SDUJYNEYB77OBKQWFQ5KTXKQMH7VD2VWOMCCHXNGDS4OGQUTYLPQ, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:38.038809585 (44h24m13.391594693s) [noise=true , address=104.36.82.44:4878 , piece_id=MCOVV7FA6IDRFXQDJWSOHOVPBVZLENKRU4CBZ2T3Q5WBXPA4U5NA, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:38.040824920 (44h24m13.393610028s) [noise=true , address=104.36.82.23:4466 , piece_id=Q7AJOUKVFA5QX2RBN6W75TMWBPZQ3QX5JVBRTYFFYRRKY5ENJCCQ, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:38.117845435 (44h24m13.470630543s) [noise=true , address=104.36.82.6:4907 , piece_id=R5ZFAQG4OIQ7K27AIYDUJCVU6EOLT2CBQZFVPI5GSVTAQTPOWWBA, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:38.189681963 (44h24m13.542467071s) [noise=true , address=79.127.205.246:4278 , piece_id=HIJ335H7NKGXPPUIVVWJT6QFOZBZ25VWFJZCX52JYHENIYNMD3KA, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:38.210948722 (44h24m13.56373382s) [noise=true , address=79.127.205.245:4246 , piece_id=CQMP3UTW6XYUXALZQ3STEF5GSYS5EOALFQARTFUSFVS5VQXDIK3A, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:38.272693461 (44h24m13.625478558s) [noise=true , address=64.49.13.138:4483 , piece_id=BKT6YGXJQLAKEXL5WEU6TMKETCHM2NVSNZN5CX2PLGKKGKEWYDWQ, seg_pos={0 0}, upload=39121]: Done uploading piece. err: <nil>
Aug 31 10:32:50.133827022 (44h24m25.486612121s) [noise=true , address=45.91.116.12:4250 , piece_id=47BV4FLTJ2S3HDCVQW4MAHLY6AKXP5AHBAQ2ITH5N2IGGWV4OYXQ, seg_pos={0 0}, upload=39121]: Done uploading piece. err: ecclient: upload failed (node:1KvoMM3ptQXSxPhXFe3UoS145h8n3DMT9qmeaoR3bqNa8KLMm9, address:45.91.116.12:4250): protocol: rpc: dial tcp 45.91.116.12:4250: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:50.133875795 (44h24m25.486660903s) [noise=true , address=77.90.31.15:4712 , piece_id=24XA26WS36ZQACFBP2GLOFW36QT7PIGUDUBYPHKKCRFWLRXHW3VA, seg_pos={0 0}, upload=39121]: Done uploading piece. err: ecclient: upload failed (node:1bfFfSGARVArNEgchuNzxf7j1QzNbq84fuac8TRfzzsuGGCeT8, address:77.90.31.15:4712): protocol: write tcp 5.161.89.252:37168->77.90.31.15:4712: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:50.133898728 (44h24m25.486683826s) [noise=true , address=77.90.31.17:4793 , piece_id=VECKC27HBUMBIJYLG5PWQDH6XYBM3A3VOGE2OUB4UA2V2IBFVZXQ, seg_pos={0 0}, upload=39121]: Done uploading piece. err: ecclient: upload failed (node:1rxrH2F4LTfrK9SMsNNEuqVr4AjV1VbEYDc3veWbQf88rj2Es4, address:77.90.31.17:4793): protocol: rpc: dial tcp 77.90.31.17:4793: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:50.133955264 (44h24m25.486740372s) [noise=true , address=77.90.31.14:4679 , piece_id=3OD5GGY27JNPKRAJZ7CQXSKOJQV24IMSHXPCRAX4VLFMM45X6L3Q, seg_pos={0 0}, upload=39121]: Done uploading piece. err: ecclient: upload failed (node:1k29MGpez3ByMHnG8qGBm9iPwo3VrKUGDHpz9CqGEGNn47rxDx, address:77.90.31.14:4679): protocol: rpc: dial tcp 77.90.31.14:4679: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:50.133986532 (44h24m25.48677164s) [noise=true , address=45.91.116.13:4176 , piece_id=GIY3ZW54DQGYQA7L3OEWAQGQOV26MMEVXPO7BGFXRXPPWAXYV2HQ, seg_pos={0 0}, upload=39121]: Done uploading piece. err: ecclient: upload failed (node:12ejsmBd4tAVwTHjamPYbryQb5x2vDnk9pBuX3CBF9WYFhTrFVJ, address:45.91.116.13:4176): protocol: rpc: dial tcp 45.91.116.13:4176: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:50.134003865 (44h24m25.486788973s) [noise=true , address=45.91.116.11:4128 , piece_id=FLJ6NZETQQ6HZJDMMSZVFBT3N6ZJIMBZMOBOYJPJUUJ3JPLIE2CA, seg_pos={0 0}, upload=39121]: Done uploading piece. err: ecclient: upload failed (node:1KorP1RYu8fCZJGQNN1Bcr4iqEnaZkhojDCxPewUeN86Byrrzj, address:45.91.116.11:4128): protocol: write tcp 5.161.89.252:57378->45.91.116.11:4128: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:50.134031748 (44h24m25.486816856s) [seg_pos={0 0}, upload=39121]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Aug 31 10:32:50.153231856 (44h24m25.506016954s) [upload=39121]: Done uploading segments...
Aug 31 10:32:50.153247595 (44h24m25.506032694s) [upload=39121]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1m0.024030628s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.00137536s
FAIL (2025-08-31 10:32:41 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001395728s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
271.128274ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
FAIL (2025-08-31 10:32:40 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": dial tcp: lookup uptime-checks.gateway.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:29236->100.100.100.100:53: i/o timeout
Duration: 271.156077ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.025772482s
FAIL (2025-08-31 10:32:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
...
Aug 31 10:32:29.762432511 (44h24m5.115217649s) [seg_pos={0 0}, upload=39118]: Done begin upload segment.
Aug 31 10:32:29.762482704 (44h24m5.115267843s) [noise=true , address=77.90.31.11:4555 , piece_id=H6UTDCPVXWLEKN7R3YFTQF5FHMP5SA4RKKBLRDAIWBY7YPZGODAQ, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.762506791 (44h24m5.115291929s) [noise=true , address=77.90.31.17:4771 , piece_id=JRLFCOFORAHUCRTN7TJNGKN3KYF5PS346DMKVH5HURKFSSNTHKRQ, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.762963380 (44h24m5.115748478s) [noise=true , address=45.91.116.6:4974 , piece_id=QQLXL3WMS2TVIWOS4BB7YUFWJQCP4DL4WHOQHXRS5PVF55TPLDGA, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.763090109 (44h24m5.115875237s) [noise=true , address=45.91.116.14:4189 , piece_id=XJTUWUN6LC5PPONG4VROKA6ZVX7S2OAGOBZRWA3BYILHOZZRGETA, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.763200918 (44h24m5.115986026s) [noise=true , address=45.91.116.13:4155 , piece_id=72ROATMK2HTDOM2TSW3G35W6XPMUJCBDP5V7ONX2XVNWCLBJG6RA, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.763434447 (44h24m5.116219555s) [noise=true , address=45.91.116.9:4261 , piece_id=SVP7KSO2KDBGOZ5Z4W5NVQ52TWYOXNCD6ABK6ICMS3SCIQ756YWQ, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.763661644 (44h24m5.116446743s) [noise=true , address=104.36.82.13:4185 , piece_id=D6ZT3HKYPXDDSETUJV3JDBER5JLCL6GB2EQAU2I4IZLDYONQ6SDA, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.763665632 (44h24m5.11645076s) [noise=true , address=77.90.31.14:4662 , piece_id=XLTPGCG732ZAQ7UE3VNJEDJQYMDINF5AJ4RWHR5JHD77MXSHNYGA, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.763869697 (44h24m5.116654795s) [noise=true , address=104.36.82.15:4258 , piece_id=X3JBU5PUCHRTNLUPFIS4HAGP2OETJCYKCXTE3DZFI57BLKTOWDXQ, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.764101884 (44h24m5.116886992s) [noise=true , address=104.36.82.12:4151 , piece_id=KEJOG26KHQUCX2QCQVJZZQHGKKAAGWT4VIQHXD7ZJQ54UJEOGCVA, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.764251485 (44h24m5.117036623s) [noise=true , address=45.91.116.7:4010 , piece_id=UR4BYFWQ3Z4PXHTDMF3WPXDF5LIOJFYNTRH2TWBDYFGBA3UEVGBQ, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.764976160 (44h24m5.117761288s) [noise=true , address=45.91.116.4:4938 , piece_id=K2DU2RBJJ27UIVOEHFQ3UT4KBPDFYHSNC2KKRKB4RD3NTGSDIBFQ, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.765622696 (44h24m5.118407825s) [noise=true , address=104.36.82.5:4840 , piece_id=A4HEG2S5MCJTMFUBVIQ552WQVZMNUOGONVOVNQPQT535PHNPKIQA, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.766155590 (44h24m5.118940718s) [noise=true , address=45.91.116.10:4081 , piece_id=CZ5HXCKLPZAN7CJIOSKVM6QR7BN44FPI4AOSWIGNJSL3KYECT6TQ, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.767299956 (44h24m5.120085083s) [noise=true , address=77.90.31.10:4520 , piece_id=XD3ZWJYA35QKXJ25FNCNJTBGLX6L53LBHBPRDZKHP25NXF2LGLKQ, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.786006364 (44h24m5.138791491s) [noise=true , address=104.36.82.15:4259 , piece_id=SKWK4IST7OZIV4YIW5XOCFEC55TPHTW3CR6MLPAIXLP3P774WTKQ, seg_pos={0 0}, upload=39118]: Uploading piece...
Aug 31 10:32:29.887696275 (44h24m5.240481373s) [upload=39118]: Next returned nil segment
Aug 31 10:32:29.887708989 (44h24m5.240494087s) [upload=39118]: Waiting for error group managing segments...
Aug 31 10:32:29.902132345 (44h24m5.254917453s) [noise=true , address=104.36.82.15:4259 , piece_id=SKWK4IST7OZIV4YIW5XOCFEC55TPHTW3CR6MLPAIXLP3P774WTKQ, seg_pos={0 0}, upload=39118]: Done uploading piece. err: <nil>
Aug 31 10:32:29.902461024 (44h24m5.255246122s) [noise=true , address=104.36.82.15:4258 , piece_id=X3JBU5PUCHRTNLUPFIS4HAGP2OETJCYKCXTE3DZFI57BLKTOWDXQ, seg_pos={0 0}, upload=39118]: Done uploading piece. err: <nil>
Aug 31 10:32:30.088551448 (44h24m5.441336556s) [noise=true , address=104.36.82.5:4840 , piece_id=A4HEG2S5MCJTMFUBVIQ552WQVZMNUOGONVOVNQPQT535PHNPKIQA, seg_pos={0 0}, upload=39118]: Done uploading piece. err: <nil>
Aug 31 10:32:30.098100796 (44h24m5.450885904s) [noise=true , address=104.36.82.12:4151 , piece_id=KEJOG26KHQUCX2QCQVJZZQHGKKAAGWT4VIQHXD7ZJQ54UJEOGCVA, seg_pos={0 0}, upload=39118]: Done uploading piece. err: <nil>
Aug 31 10:32:30.190174254 (44h24m5.542959382s) [noise=true , address=104.36.82.13:4185 , piece_id=D6ZT3HKYPXDDSETUJV3JDBER5JLCL6GB2EQAU2I4IZLDYONQ6SDA, seg_pos={0 0}, upload=39118]: Done uploading piece. err: <nil>
Aug 31 10:32:36.109450692 (44h24m11.46223583s) [noise=true , address=45.91.116.7:4010 , piece_id=UR4BYFWQ3Z4PXHTDMF3WPXDF5LIOJFYNTRH2TWBDYFGBA3UEVGBQ, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.109589133 (44h24m11.46237427s) [noise=true , address=77.90.31.11:4555 , piece_id=H6UTDCPVXWLEKN7R3YFTQF5FHMP5SA4RKKBLRDAIWBY7YPZGODAQ, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.109682118 (44h24m11.462467246s) [noise=true , address=77.90.31.17:4771 , piece_id=JRLFCOFORAHUCRTN7TJNGKN3KYF5PS346DMKVH5HURKFSSNTHKRQ, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:12AxqL8pD57cAVRsoNMBsqjWCvRwnKYwb9ESatQQZLRxFEGCjq2, address:77.90.31.17:4771): protocol: rpc: dial tcp 77.90.31.17:4771: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.109740097 (44h24m11.462525225s) [noise=true , address=45.91.116.14:4189 , piece_id=XJTUWUN6LC5PPONG4VROKA6ZVX7S2OAGOBZRWA3BYILHOZZRGETA, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 5.161.89.252:47408->45.91.116.14:4189: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.109789630 (44h24m11.462574757s) [noise=true , address=77.90.31.14:4662 , piece_id=XLTPGCG732ZAQ7UE3VNJEDJQYMDINF5AJ4RWHR5JHD77MXSHNYGA, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: write tcp 5.161.89.252:24434->77.90.31.14:4662: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.109851597 (44h24m11.462636724s) [noise=true , address=77.90.31.10:4520 , piece_id=XD3ZWJYA35QKXJ25FNCNJTBGLX6L53LBHBPRDZKHP25NXF2LGLKQ, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: rpc: dial tcp 77.90.31.10:4520: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.109864400 (44h24m11.462649529s) [noise=true , address=45.91.116.6:4974 , piece_id=QQLXL3WMS2TVIWOS4BB7YUFWJQCP4DL4WHOQHXRS5PVF55TPLDGA, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:12QcCaYzZBn68gjUAz268u1Hxd9apcc9F77coF8uKya1ycHdHEJ, address:45.91.116.6:4974): protocol: rpc: dial tcp 45.91.116.6:4974: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.109922910 (44h24m11.462708039s) [noise=true , address=45.91.116.13:4155 , piece_id=72ROATMK2HTDOM2TSW3G35W6XPMUJCBDP5V7ONX2XVNWCLBJG6RA, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: rpc: dial tcp 45.91.116.13:4155: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.109952698 (44h24m11.462737825s) [noise=true , address=45.91.116.4:4938 , piece_id=K2DU2RBJJ27UIVOEHFQ3UT4KBPDFYHSNC2KKRKB4RD3NTGSDIBFQ, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: rpc: dial tcp 45.91.116.4:4938: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.109994115 (44h24m11.462779243s) [noise=true , address=45.91.116.9:4261 , piece_id=SVP7KSO2KDBGOZ5Z4W5NVQ52TWYOXNCD6ABK6ICMS3SCIQ756YWQ, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 5.161.89.252:29720->45.91.116.9:4261: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.110007901 (44h24m11.462793029s) [noise=true , address=45.91.116.10:4081 , piece_id=CZ5HXCKLPZAN7CJIOSKVM6QR7BN44FPI4AOSWIGNJSL3KYECT6TQ, seg_pos={0 0}, upload=39118]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: rpc: dial tcp 45.91.116.10:4081: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 31 10:32:36.110040011 (44h24m11.462825139s) [seg_pos={0 0}, upload=39118]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Aug 31 10:32:36.133421710 (44h24m11.486206848s) [upload=39118]: Done uploading segments...
Aug 31 10:32:36.133449283 (44h24m11.486234421s) [upload=39118]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 30.025801186s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000999222s
FAIL (2025-08-31 10:32:36 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.0010192s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://www.storj.io/dcs-satellites", ExpectedStatus: 301, ExpectedRedirect: "https://static.storj.io/dcs-satellites"} failure (antiblip window 6/15): (http.www_dcs_satellites_redirect)antiblip:
8 out of 15 is failed (threshold=6) [XX...X..X.XXXX.] duration:
88.561566ms remote:
"tcp:34.202.203.47:443" response headers:
Date=Sun, 31 Aug 2025 10:31:38 GMT Content-Type=text/html Location=https://static.storj.io/dcs-satellites Cache-Control=private Vary=Accept-Encoding Set-Cookie=_cfuvid=rC7f6s_HfDxv3P_qVE9lDkH3GaFX51iKlxyQPX_e44w-1756636298738-0.0.1.1-604800000; path=/; domain=.cdn.webflow.com; HttpOnly; Secure; SameSite=None Alt-Svc=h3=":443"; ma=86400 X-Cluster-Name=us-east-1-prod-hosting-red Content-Length=166 Cf-Ray=977bdc02c8db3ae8-IAD Cf-Cache-Status=BYPASS target:
https://www.storj.io/dcs-satellites
FAIL (2025-08-31 10:32:36 UTC)
orbiter warning: no valid certificate chain appears to exist after 336h0m0s
Duration: 88.585321ms
core
website
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000847253s target:
https://ap1.storj.io/login
FAIL (2025-08-31 10:32:33 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout
Duration: 30.000913317s
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
204.191432ms
FAIL (2025-08-31 10:32:31 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 204.215567ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000939998s
FAIL (2025-08-31 10:32:30 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 30.000964344s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
53.803025ms target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
FAIL (2025-08-31 10:32:30 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222": dial tcp: lookup uptime-checks.gateway.storjshare.io on 100.100.100.100:53: read udp 100.64.0.137:29236->100.100.100.100:53: i/o timeout
Duration: 53.839754ms
edge
gateway
vhost
bgp
us1
|