Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.261203ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=1898CB6F19D6B004 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:35:31 GMT Content-Length=274 Server=Storj X-Request-Id=PojcaC1ciHz Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1ca676c2e64ee14c
FAIL (2026-03-01 18:35:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB6F19D6B004</RequestId><HostId></HostId></Error>"
Duration: 23.279318ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.381071ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin X-Amz-Request-Id=1898CB6DDA9E3173 Date=Sun, 01 Mar 2026 18:35:26 GMT Content-Security-Policy=block-all-mixed-content X-Request-Id=Z9fJF8mqyt9 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3a66a0221cb90bf6
FAIL (2026-03-01 18:35:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB6DDA9E3173</RequestId><HostId></HostId></Error>"
Duration: 24.393335ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.27755ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1898CB6C9387526C Date=Sun, 01 Mar 2026 18:35:20 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=Nuk3Ar2F3Ef X-Xss-Protection=1; mode=block Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1434be5fdcd53303
FAIL (2026-03-01 18:35:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB6C9387526C</RequestId><HostId></HostId></Error>"
Duration: 22.293229ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.646649ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=UEFYmnp2qqd Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=1898CB67E3B89555 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:35:00 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/fefa6eeb4fa5539
FAIL (2026-03-01 18:35:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB67E3B89555</RequestId><HostId></HostId></Error>"
Duration: 27.663651ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.155546ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=J9WJEtdf6AF Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898CB64EC8590E0 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:34:47 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/262f51d08fa3ac79
FAIL (2026-03-01 18:34:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB64EC8590E0</RequestId><HostId></HostId></Error>"
Duration: 7.166196ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.779931ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898CB64F7107AD1 Date=Sun, 01 Mar 2026 18:34:47 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=64Ht7SuiXrY X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/d7c1fb13c7024c3
FAIL (2026-03-01 18:34:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB64F7107AD1</RequestId><HostId></HostId></Error>"
Duration: 22.78975ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.767071ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898CB64AA6099E2 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:34:46 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=6NaDMJycHEj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/379fb47325cf528f
FAIL (2026-03-01 18:34:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB64AA6099E2</RequestId><HostId></HostId></Error>"
Duration: 23.780645ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.738377ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=LGbXeo2u4xX X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:34:21 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Content-Length=284 X-Amz-Request-Id=1898CB5EDFCDD775 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/482f108420bdc8a6
FAIL (2026-03-01 18:34:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB5EDFCDD775</RequestId><HostId></HostId></Error>"
Duration: 12.75609ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.805664ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin Date=Sun, 01 Mar 2026 18:34:16 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1898CB5DB9F5879A X-Request-Id=gStRUV8Afvg X-Xss-Protection=1; mode=block Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/78d719c2456f447
FAIL (2026-03-01 18:34:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB5DB9F5879A</RequestId><HostId></HostId></Error>"
Duration: 23.822053ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.129772ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:34:09 GMT Content-Length=274 X-Amz-Request-Id=1898CB5C07B3A11A X-Request-Id=aq3JXS6doTA target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3bb5efb08e222e5d
FAIL (2026-03-01 18:34:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB5C07B3A11A</RequestId><HostId></HostId></Error>"
Duration: 22.139871ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.578499ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1898CB5A965AB6E8 X-Request-Id=SaGYRtpDX6k X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Date=Sun, 01 Mar 2026 18:34:03 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/330738907f94ebd4
FAIL (2026-03-01 18:34:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB5A965AB6E8</RequestId><HostId></HostId></Error>"
Duration: 26.593376ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.232020161s trace:
https://jaeger.dev.storj.io/trace/6409f9bfcd59d0a0
FAIL (2026-03-01 18:33:48 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357343755 (285h41m33.496327949s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357767469 (285h41m33.496751663s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.358341195 (285h41m33.497325389s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.363880022 (285h41m33.502864216s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.364001479 (285h41m33.502985673s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.365332803 (285h41m33.504316998s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.366574020 (285h41m33.505558214s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.367686234 (285h41m33.506670418s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.368802976 (285h41m33.50778717s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.369883561 (285h41m33.508867745s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.372958261 (285h41m33.511942445s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.826802472 (285h41m33.965786656s) [upload=251212]: Next returned nil segment
Mar 1 17:50:14.826813533 (285h41m33.965797727s) [upload=251212]: Waiting for error group managing segments...
Mar 1 17:50:15.017217575 (285h41m34.156201759s) [noise=true , address=185.167.204.206:4058 , piece_id=Y6HEVFTQBPYNJXDC6JLVM4YRD6JJTSSFG2LFHWN2QVBK3RAJWULQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.030107146 (285h41m34.169091341s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.033619627 (285h41m34.172603811s) [noise=true , address=89.149.201.147:4010 , piece_id=I57BTZJT5CCAK7ZVH5US4J5DL3L7W7TQXRMXXZOPFXSXKIG6UBBA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.041207315 (285h41m34.180191509s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.043293673 (285h41m34.182277867s) [noise=true , address=185.167.204.205:4009 , piece_id=2TA2A3X2SS33Q5TO5RBAEZCZBFBS37MH2TWCR53QOIPLBW3GCL2Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.048398598 (285h41m34.187382782s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.058585996 (285h41m34.197570191s) [noise=true , address=81.171.14.70:4044 , piece_id=AAIXAMMRDYF5WNRS2EJSTVYHDSJDF4F3ZX6AWIMQIVVIVRQUOYLQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.064976971 (285h41m34.203961155s) [noise=true , address=81.171.14.70:4045 , piece_id=LQ3SVBUG6LRPUORF2DTJPTA7WFH5BLFYHTXF44HFKLXKBCLQTMPA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.072542085 (285h41m34.211526279s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.073558409 (285h41m34.212542603s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.077825775 (285h41m34.216809959s) [noise=true , address=185.167.204.205:4003 , piece_id=K6OZGDZPSJEY2SU7FZNFAMXXZ6XBRDZZQWKLH7JDWV2IMMXOPBEQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080093774 (285h41m34.219077958s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080863126 (285h41m34.219847321s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.083339837 (285h41m34.222324031s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.085816768 (285h41m34.224800962s) [noise=true , address=81.171.14.70:4030 , piece_id=MVNAAWHVDWEUFH3LI4OYOGIBFDA5QVMOWLAWX2T4NVCPVMXW53WQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.086581150 (285h41m34.225565344s) [noise=true , address=185.167.204.206:4044 , piece_id=K7BSTZIJZ5O3UFSUCIE2QEY73F6NS656LHCJCQOGKN6WXGYLJNDQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.089190699 (285h41m34.228174883s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.119055626 (285h41m34.258039811s) [noise=true , address=89.149.201.147:4019 , piece_id=MJ7UTA7W6D74X6SCNDPW2SGNM6GA7IMTVI4JNLTQM3M7O5HLR7BA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120683066 (285h41m34.25966725s) [noise=true , address=185.167.204.205:4015 , piece_id=TAPHD35KOHH4VYY6Z73KA5JFZT3VNFTZG4YARR6ETPGNSUSZYTWA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120920100 (285h41m34.259904314s) [noise=true , address=185.167.204.205:4014 , piece_id=YORPAGOGXFQZV44LN4YEBAQVXRBMT7H5SC2OJETJWSRU7367QSFQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.485466929 (285h41m34.624451123s) [noise=true , address=89.149.201.147:4011 , piece_id=6KVSDMMOJOVKFELYU564B6USMMTNSF2NIFL72YZWMQVG4GYJOP6A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.510639133 (285h41m34.649623327s) [noise=true , address=89.149.201.147:4013 , piece_id=MEFNG6LZ7643OHIAHDPTCMEM5QGNEGXDF524CR3T5TE7YP2EGEFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.524099082 (285h41m34.663083266s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.535501987 (285h41m34.674486181s) [noise=true , address=81.171.14.70:4046 , piece_id=HLZUT3Q52XGLGZ6JG4SYDSAJMZ2ROAN7NTHV2FUFRUERUDJUA5DA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.540435691 (285h41m34.679419885s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:51:13.974183086 (285h42m33.113167271s) [noise=true , address=185.167.204.205:4027 , piece_id=QPQDPDZXNP2OB7VNFAPFUKCWPTAHGUABFPJIVGFK22AE5WIMVOOQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection
Mar 1 17:51:13.974201662 (285h42m33.113185845s) [noise=true , address=185.167.204.206:4057 , piece_id=QIME5J2R4CUHXAMXXZH56GPFZX5FN2W5SSA4RR6ZJQ2CI23FPRKQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 5.161.89.252:48350->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:13.974291951 (285h42m33.113276134s) [noise=true , address=185.167.204.205:4004 , piece_id=QHOQGVUE7PTUJCJVC43OQMP674UVIML7COEWUPGZB7MWQKJKTKMQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 5.161.89.252:39082->185.167.204.205:4004: use of closed network connection; context deadline exceeded
Mar 1 17:51:13.974310305 (285h42m33.113294479s) [seg_pos={0 0}, upload=251212]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:14.082129983 (285h42m33.221114167s) [upload=251212]: Done uploading segments...
Mar 1 17:51:14.082167263 (285h42m33.221151447s) [upload=251212]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.232037231s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.391229ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin Accept-Ranges=bytes X-Amz-Request-Id=1898CB556D97A742 X-Request-Id=LZMuThVTzvP X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:33:41 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/11dedcbc22ace228
FAIL (2026-03-01 18:33:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB556D97A742</RequestId><HostId></HostId></Error>"
Duration: 7.408009ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.309891ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CB552FD0CF48 Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=A4cJSmybUrR X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:33:40 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/307d4b9e8dbec6ad
FAIL (2026-03-01 18:33:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB552FD0CF48</RequestId><HostId></HostId></Error>"
Duration: 22.325779ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.212837929s trace:
https://jaeger.dev.storj.io/trace/6409f9bfcd59d0a0
FAIL (2026-03-01 18:33:30 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357343755 (285h41m33.496327949s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357767469 (285h41m33.496751663s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.358341195 (285h41m33.497325389s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.363880022 (285h41m33.502864216s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.364001479 (285h41m33.502985673s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.365332803 (285h41m33.504316998s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.366574020 (285h41m33.505558214s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.367686234 (285h41m33.506670418s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.368802976 (285h41m33.50778717s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.369883561 (285h41m33.508867745s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.372958261 (285h41m33.511942445s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.826802472 (285h41m33.965786656s) [upload=251212]: Next returned nil segment
Mar 1 17:50:14.826813533 (285h41m33.965797727s) [upload=251212]: Waiting for error group managing segments...
Mar 1 17:50:15.017217575 (285h41m34.156201759s) [noise=true , address=185.167.204.206:4058 , piece_id=Y6HEVFTQBPYNJXDC6JLVM4YRD6JJTSSFG2LFHWN2QVBK3RAJWULQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.030107146 (285h41m34.169091341s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.033619627 (285h41m34.172603811s) [noise=true , address=89.149.201.147:4010 , piece_id=I57BTZJT5CCAK7ZVH5US4J5DL3L7W7TQXRMXXZOPFXSXKIG6UBBA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.041207315 (285h41m34.180191509s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.043293673 (285h41m34.182277867s) [noise=true , address=185.167.204.205:4009 , piece_id=2TA2A3X2SS33Q5TO5RBAEZCZBFBS37MH2TWCR53QOIPLBW3GCL2Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.048398598 (285h41m34.187382782s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.058585996 (285h41m34.197570191s) [noise=true , address=81.171.14.70:4044 , piece_id=AAIXAMMRDYF5WNRS2EJSTVYHDSJDF4F3ZX6AWIMQIVVIVRQUOYLQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.064976971 (285h41m34.203961155s) [noise=true , address=81.171.14.70:4045 , piece_id=LQ3SVBUG6LRPUORF2DTJPTA7WFH5BLFYHTXF44HFKLXKBCLQTMPA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.072542085 (285h41m34.211526279s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.073558409 (285h41m34.212542603s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.077825775 (285h41m34.216809959s) [noise=true , address=185.167.204.205:4003 , piece_id=K6OZGDZPSJEY2SU7FZNFAMXXZ6XBRDZZQWKLH7JDWV2IMMXOPBEQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080093774 (285h41m34.219077958s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080863126 (285h41m34.219847321s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.083339837 (285h41m34.222324031s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.085816768 (285h41m34.224800962s) [noise=true , address=81.171.14.70:4030 , piece_id=MVNAAWHVDWEUFH3LI4OYOGIBFDA5QVMOWLAWX2T4NVCPVMXW53WQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.086581150 (285h41m34.225565344s) [noise=true , address=185.167.204.206:4044 , piece_id=K7BSTZIJZ5O3UFSUCIE2QEY73F6NS656LHCJCQOGKN6WXGYLJNDQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.089190699 (285h41m34.228174883s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.119055626 (285h41m34.258039811s) [noise=true , address=89.149.201.147:4019 , piece_id=MJ7UTA7W6D74X6SCNDPW2SGNM6GA7IMTVI4JNLTQM3M7O5HLR7BA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120683066 (285h41m34.25966725s) [noise=true , address=185.167.204.205:4015 , piece_id=TAPHD35KOHH4VYY6Z73KA5JFZT3VNFTZG4YARR6ETPGNSUSZYTWA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120920100 (285h41m34.259904314s) [noise=true , address=185.167.204.205:4014 , piece_id=YORPAGOGXFQZV44LN4YEBAQVXRBMT7H5SC2OJETJWSRU7367QSFQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.485466929 (285h41m34.624451123s) [noise=true , address=89.149.201.147:4011 , piece_id=6KVSDMMOJOVKFELYU564B6USMMTNSF2NIFL72YZWMQVG4GYJOP6A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.510639133 (285h41m34.649623327s) [noise=true , address=89.149.201.147:4013 , piece_id=MEFNG6LZ7643OHIAHDPTCMEM5QGNEGXDF524CR3T5TE7YP2EGEFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.524099082 (285h41m34.663083266s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.535501987 (285h41m34.674486181s) [noise=true , address=81.171.14.70:4046 , piece_id=HLZUT3Q52XGLGZ6JG4SYDSAJMZ2ROAN7NTHV2FUFRUERUDJUA5DA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.540435691 (285h41m34.679419885s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:51:13.974183086 (285h42m33.113167271s) [noise=true , address=185.167.204.205:4027 , piece_id=QPQDPDZXNP2OB7VNFAPFUKCWPTAHGUABFPJIVGFK22AE5WIMVOOQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection
Mar 1 17:51:13.974201662 (285h42m33.113185845s) [noise=true , address=185.167.204.206:4057 , piece_id=QIME5J2R4CUHXAMXXZH56GPFZX5FN2W5SSA4RR6ZJQ2CI23FPRKQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 5.161.89.252:48350->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:13.974291951 (285h42m33.113276134s) [noise=true , address=185.167.204.205:4004 , piece_id=QHOQGVUE7PTUJCJVC43OQMP674UVIML7COEWUPGZB7MWQKJKTKMQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 5.161.89.252:39082->185.167.204.205:4004: use of closed network connection; context deadline exceeded
Mar 1 17:51:13.974310305 (285h42m33.113294479s) [seg_pos={0 0}, upload=251212]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:14.082129983 (285h42m33.221114167s) [upload=251212]: Done uploading segments...
Mar 1 17:51:14.082167263 (285h42m33.221151447s) [upload=251212]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.212859319s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.970922ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=1898CB5072E818C5 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:33:19 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=Ztmo8rZiBMX target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3b5db965dc3d16ad
FAIL (2026-03-01 18:33:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB5072E818C5</RequestId><HostId></HostId></Error>"
Duration: 12.987574ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.188202ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=VLDB35jxcnw X-Xss-Protection=1; mode=block X-Amz-Request-Id=1898CB4F9E0E7ECD Date=Sun, 01 Mar 2026 18:33:16 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7b490c5a630e8bd3
FAIL (2026-03-01 18:33:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB4F9E0E7ECD</RequestId><HostId></HostId></Error>"
Duration: 22.197902ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.221603ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=YK1cCUEu3oC Date=Sun, 01 Mar 2026 18:33:12 GMT Content-Length=274 Vary=Origin X-Amz-Request-Id=1898CB4EC0F5A8A6 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/7b485c16c9692e4a
FAIL (2026-03-01 18:33:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB4EC0F5A8A6</RequestId><HostId></HostId></Error>"
Duration: 27.239127ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.685416848s trace:
https://jaeger.dev.storj.io/trace/6409f9bfcd59d0a0
FAIL (2026-03-01 18:33:08 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357343755 (285h41m33.496327949s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357767469 (285h41m33.496751663s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.358341195 (285h41m33.497325389s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.363880022 (285h41m33.502864216s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.364001479 (285h41m33.502985673s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.365332803 (285h41m33.504316998s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.366574020 (285h41m33.505558214s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.367686234 (285h41m33.506670418s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.368802976 (285h41m33.50778717s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.369883561 (285h41m33.508867745s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.372958261 (285h41m33.511942445s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.826802472 (285h41m33.965786656s) [upload=251212]: Next returned nil segment
Mar 1 17:50:14.826813533 (285h41m33.965797727s) [upload=251212]: Waiting for error group managing segments...
Mar 1 17:50:15.017217575 (285h41m34.156201759s) [noise=true , address=185.167.204.206:4058 , piece_id=Y6HEVFTQBPYNJXDC6JLVM4YRD6JJTSSFG2LFHWN2QVBK3RAJWULQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.030107146 (285h41m34.169091341s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.033619627 (285h41m34.172603811s) [noise=true , address=89.149.201.147:4010 , piece_id=I57BTZJT5CCAK7ZVH5US4J5DL3L7W7TQXRMXXZOPFXSXKIG6UBBA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.041207315 (285h41m34.180191509s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.043293673 (285h41m34.182277867s) [noise=true , address=185.167.204.205:4009 , piece_id=2TA2A3X2SS33Q5TO5RBAEZCZBFBS37MH2TWCR53QOIPLBW3GCL2Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.048398598 (285h41m34.187382782s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.058585996 (285h41m34.197570191s) [noise=true , address=81.171.14.70:4044 , piece_id=AAIXAMMRDYF5WNRS2EJSTVYHDSJDF4F3ZX6AWIMQIVVIVRQUOYLQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.064976971 (285h41m34.203961155s) [noise=true , address=81.171.14.70:4045 , piece_id=LQ3SVBUG6LRPUORF2DTJPTA7WFH5BLFYHTXF44HFKLXKBCLQTMPA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.072542085 (285h41m34.211526279s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.073558409 (285h41m34.212542603s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.077825775 (285h41m34.216809959s) [noise=true , address=185.167.204.205:4003 , piece_id=K6OZGDZPSJEY2SU7FZNFAMXXZ6XBRDZZQWKLH7JDWV2IMMXOPBEQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080093774 (285h41m34.219077958s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080863126 (285h41m34.219847321s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.083339837 (285h41m34.222324031s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.085816768 (285h41m34.224800962s) [noise=true , address=81.171.14.70:4030 , piece_id=MVNAAWHVDWEUFH3LI4OYOGIBFDA5QVMOWLAWX2T4NVCPVMXW53WQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.086581150 (285h41m34.225565344s) [noise=true , address=185.167.204.206:4044 , piece_id=K7BSTZIJZ5O3UFSUCIE2QEY73F6NS656LHCJCQOGKN6WXGYLJNDQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.089190699 (285h41m34.228174883s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.119055626 (285h41m34.258039811s) [noise=true , address=89.149.201.147:4019 , piece_id=MJ7UTA7W6D74X6SCNDPW2SGNM6GA7IMTVI4JNLTQM3M7O5HLR7BA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120683066 (285h41m34.25966725s) [noise=true , address=185.167.204.205:4015 , piece_id=TAPHD35KOHH4VYY6Z73KA5JFZT3VNFTZG4YARR6ETPGNSUSZYTWA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120920100 (285h41m34.259904314s) [noise=true , address=185.167.204.205:4014 , piece_id=YORPAGOGXFQZV44LN4YEBAQVXRBMT7H5SC2OJETJWSRU7367QSFQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.485466929 (285h41m34.624451123s) [noise=true , address=89.149.201.147:4011 , piece_id=6KVSDMMOJOVKFELYU564B6USMMTNSF2NIFL72YZWMQVG4GYJOP6A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.510639133 (285h41m34.649623327s) [noise=true , address=89.149.201.147:4013 , piece_id=MEFNG6LZ7643OHIAHDPTCMEM5QGNEGXDF524CR3T5TE7YP2EGEFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.524099082 (285h41m34.663083266s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.535501987 (285h41m34.674486181s) [noise=true , address=81.171.14.70:4046 , piece_id=HLZUT3Q52XGLGZ6JG4SYDSAJMZ2ROAN7NTHV2FUFRUERUDJUA5DA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.540435691 (285h41m34.679419885s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:51:13.974183086 (285h42m33.113167271s) [noise=true , address=185.167.204.205:4027 , piece_id=QPQDPDZXNP2OB7VNFAPFUKCWPTAHGUABFPJIVGFK22AE5WIMVOOQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection
Mar 1 17:51:13.974201662 (285h42m33.113185845s) [noise=true , address=185.167.204.206:4057 , piece_id=QIME5J2R4CUHXAMXXZH56GPFZX5FN2W5SSA4RR6ZJQ2CI23FPRKQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 5.161.89.252:48350->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:13.974291951 (285h42m33.113276134s) [noise=true , address=185.167.204.205:4004 , piece_id=QHOQGVUE7PTUJCJVC43OQMP674UVIML7COEWUPGZB7MWQKJKTKMQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 5.161.89.252:39082->185.167.204.205:4004: use of closed network connection; context deadline exceeded
Mar 1 17:51:13.974310305 (285h42m33.113294479s) [seg_pos={0 0}, upload=251212]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:14.082129983 (285h42m33.221114167s) [upload=251212]: Done uploading segments...
Mar 1 17:51:14.082167263 (285h42m33.221151447s) [upload=251212]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.685470319s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.545556ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 18:32:50 GMT Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=2M8moZoMBxo X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1898CB49924F5ED0 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/18298faf31864191
FAIL (2026-03-01 18:32:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB49924F5ED0</RequestId><HostId></HostId></Error>"
Duration: 23.563179ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.293393ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CB44D9A0A06F X-Request-Id=gbBKBCoweED X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:32:29 GMT Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/aa8cf4177e5d7b9
FAIL (2026-03-01 18:32:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB44D9A0A06F</RequestId><HostId></HostId></Error>"
Duration: 12.309973ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.017184ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:32:26 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CB4405702F30 X-Request-Id=U4ZVF6Xiqg3 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/f3c794aea9aafb5
FAIL (2026-03-01 18:32:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB4405702F30</RequestId><HostId></HostId></Error>"
Duration: 25.032331ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.812231ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898CB43CB4ACF25 X-Request-Id=E9Hr2yxpPkY X-Xss-Protection=1; mode=block Server=Storj Vary=Origin Date=Sun, 01 Mar 2026 18:32:25 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/43def4d95e8d124c
FAIL (2026-03-01 18:32:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB43CB4ACF25</RequestId><HostId></HostId></Error>"
Duration: 27.828602ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.665370318s trace:
https://jaeger.dev.storj.io/trace/6409f9bfcd59d0a0
FAIL (2026-03-01 18:32:14 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357343755 (285h41m33.496327949s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357767469 (285h41m33.496751663s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.358341195 (285h41m33.497325389s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.363880022 (285h41m33.502864216s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.364001479 (285h41m33.502985673s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.365332803 (285h41m33.504316998s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.366574020 (285h41m33.505558214s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.367686234 (285h41m33.506670418s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.368802976 (285h41m33.50778717s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.369883561 (285h41m33.508867745s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.372958261 (285h41m33.511942445s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.826802472 (285h41m33.965786656s) [upload=251212]: Next returned nil segment
Mar 1 17:50:14.826813533 (285h41m33.965797727s) [upload=251212]: Waiting for error group managing segments...
Mar 1 17:50:15.017217575 (285h41m34.156201759s) [noise=true , address=185.167.204.206:4058 , piece_id=Y6HEVFTQBPYNJXDC6JLVM4YRD6JJTSSFG2LFHWN2QVBK3RAJWULQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.030107146 (285h41m34.169091341s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.033619627 (285h41m34.172603811s) [noise=true , address=89.149.201.147:4010 , piece_id=I57BTZJT5CCAK7ZVH5US4J5DL3L7W7TQXRMXXZOPFXSXKIG6UBBA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.041207315 (285h41m34.180191509s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.043293673 (285h41m34.182277867s) [noise=true , address=185.167.204.205:4009 , piece_id=2TA2A3X2SS33Q5TO5RBAEZCZBFBS37MH2TWCR53QOIPLBW3GCL2Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.048398598 (285h41m34.187382782s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.058585996 (285h41m34.197570191s) [noise=true , address=81.171.14.70:4044 , piece_id=AAIXAMMRDYF5WNRS2EJSTVYHDSJDF4F3ZX6AWIMQIVVIVRQUOYLQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.064976971 (285h41m34.203961155s) [noise=true , address=81.171.14.70:4045 , piece_id=LQ3SVBUG6LRPUORF2DTJPTA7WFH5BLFYHTXF44HFKLXKBCLQTMPA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.072542085 (285h41m34.211526279s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.073558409 (285h41m34.212542603s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.077825775 (285h41m34.216809959s) [noise=true , address=185.167.204.205:4003 , piece_id=K6OZGDZPSJEY2SU7FZNFAMXXZ6XBRDZZQWKLH7JDWV2IMMXOPBEQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080093774 (285h41m34.219077958s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080863126 (285h41m34.219847321s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.083339837 (285h41m34.222324031s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.085816768 (285h41m34.224800962s) [noise=true , address=81.171.14.70:4030 , piece_id=MVNAAWHVDWEUFH3LI4OYOGIBFDA5QVMOWLAWX2T4NVCPVMXW53WQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.086581150 (285h41m34.225565344s) [noise=true , address=185.167.204.206:4044 , piece_id=K7BSTZIJZ5O3UFSUCIE2QEY73F6NS656LHCJCQOGKN6WXGYLJNDQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.089190699 (285h41m34.228174883s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.119055626 (285h41m34.258039811s) [noise=true , address=89.149.201.147:4019 , piece_id=MJ7UTA7W6D74X6SCNDPW2SGNM6GA7IMTVI4JNLTQM3M7O5HLR7BA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120683066 (285h41m34.25966725s) [noise=true , address=185.167.204.205:4015 , piece_id=TAPHD35KOHH4VYY6Z73KA5JFZT3VNFTZG4YARR6ETPGNSUSZYTWA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120920100 (285h41m34.259904314s) [noise=true , address=185.167.204.205:4014 , piece_id=YORPAGOGXFQZV44LN4YEBAQVXRBMT7H5SC2OJETJWSRU7367QSFQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.485466929 (285h41m34.624451123s) [noise=true , address=89.149.201.147:4011 , piece_id=6KVSDMMOJOVKFELYU564B6USMMTNSF2NIFL72YZWMQVG4GYJOP6A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.510639133 (285h41m34.649623327s) [noise=true , address=89.149.201.147:4013 , piece_id=MEFNG6LZ7643OHIAHDPTCMEM5QGNEGXDF524CR3T5TE7YP2EGEFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.524099082 (285h41m34.663083266s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.535501987 (285h41m34.674486181s) [noise=true , address=81.171.14.70:4046 , piece_id=HLZUT3Q52XGLGZ6JG4SYDSAJMZ2ROAN7NTHV2FUFRUERUDJUA5DA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.540435691 (285h41m34.679419885s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:51:13.974183086 (285h42m33.113167271s) [noise=true , address=185.167.204.205:4027 , piece_id=QPQDPDZXNP2OB7VNFAPFUKCWPTAHGUABFPJIVGFK22AE5WIMVOOQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection
Mar 1 17:51:13.974201662 (285h42m33.113185845s) [noise=true , address=185.167.204.206:4057 , piece_id=QIME5J2R4CUHXAMXXZH56GPFZX5FN2W5SSA4RR6ZJQ2CI23FPRKQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 5.161.89.252:48350->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:13.974291951 (285h42m33.113276134s) [noise=true , address=185.167.204.205:4004 , piece_id=QHOQGVUE7PTUJCJVC43OQMP674UVIML7COEWUPGZB7MWQKJKTKMQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 5.161.89.252:39082->185.167.204.205:4004: use of closed network connection; context deadline exceeded
Mar 1 17:51:13.974310305 (285h42m33.113294479s) [seg_pos={0 0}, upload=251212]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:14.082129983 (285h42m33.221114167s) [upload=251212]: Done uploading segments...
Mar 1 17:51:14.082167263 (285h42m33.221151447s) [upload=251212]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.665386889s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.696976ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj Vary=Origin Date=Sun, 01 Mar 2026 18:31:55 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1898CB3CEDABDEF1 X-Request-Id=QBFcXfLdU2i target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7db3a0290e32fc54
FAIL (2026-03-01 18:31:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB3CEDABDEF1</RequestId><HostId></HostId></Error>"
Duration: 22.713046ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.568551ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Date=Sun, 01 Mar 2026 18:31:55 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CB3CE489F823 X-Request-Id=L6Lc8Pd8t39 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/58c4fc36c71ccc1e
FAIL (2026-03-01 18:31:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB3CE489F823</RequestId><HostId></HostId></Error>"
Duration: 24.591875ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.295734ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes X-Amz-Request-Id=1898CB38FFD8F6F6 X-Request-Id=4GXGJjuLxvw X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:31:39 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/70fee11fa9ce88dd
FAIL (2026-03-01 18:31:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB38FFD8F6F6</RequestId><HostId></HostId></Error>"
Duration: 22.313146ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.312083ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898CB3709F6055E X-Request-Id=BHFSorqLXVe Content-Length=274 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:31:30 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/94d1af238dc21b1
FAIL (2026-03-01 18:31:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB3709F6055E</RequestId><HostId></HostId></Error>"
Duration: 27.330477ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.924851ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Sun, 01 Mar 2026 18:31:29 GMT Content-Length=284 Vary=Origin X-Request-Id=Np5bcDowoBd X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CB36AB542038 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3f6fd30daaafc145
FAIL (2026-03-01 18:31:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB36AB542038</RequestId><HostId></HostId></Error>"
Duration: 10.942954ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.215903553s trace:
https://jaeger.dev.storj.io/trace/6409f9bfcd59d0a0
FAIL (2026-03-01 18:31:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357343755 (285h41m33.496327949s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357767469 (285h41m33.496751663s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.358341195 (285h41m33.497325389s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.363880022 (285h41m33.502864216s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.364001479 (285h41m33.502985673s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.365332803 (285h41m33.504316998s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.366574020 (285h41m33.505558214s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.367686234 (285h41m33.506670418s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.368802976 (285h41m33.50778717s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.369883561 (285h41m33.508867745s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.372958261 (285h41m33.511942445s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.826802472 (285h41m33.965786656s) [upload=251212]: Next returned nil segment
Mar 1 17:50:14.826813533 (285h41m33.965797727s) [upload=251212]: Waiting for error group managing segments...
Mar 1 17:50:15.017217575 (285h41m34.156201759s) [noise=true , address=185.167.204.206:4058 , piece_id=Y6HEVFTQBPYNJXDC6JLVM4YRD6JJTSSFG2LFHWN2QVBK3RAJWULQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.030107146 (285h41m34.169091341s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.033619627 (285h41m34.172603811s) [noise=true , address=89.149.201.147:4010 , piece_id=I57BTZJT5CCAK7ZVH5US4J5DL3L7W7TQXRMXXZOPFXSXKIG6UBBA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.041207315 (285h41m34.180191509s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.043293673 (285h41m34.182277867s) [noise=true , address=185.167.204.205:4009 , piece_id=2TA2A3X2SS33Q5TO5RBAEZCZBFBS37MH2TWCR53QOIPLBW3GCL2Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.048398598 (285h41m34.187382782s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.058585996 (285h41m34.197570191s) [noise=true , address=81.171.14.70:4044 , piece_id=AAIXAMMRDYF5WNRS2EJSTVYHDSJDF4F3ZX6AWIMQIVVIVRQUOYLQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.064976971 (285h41m34.203961155s) [noise=true , address=81.171.14.70:4045 , piece_id=LQ3SVBUG6LRPUORF2DTJPTA7WFH5BLFYHTXF44HFKLXKBCLQTMPA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.072542085 (285h41m34.211526279s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.073558409 (285h41m34.212542603s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.077825775 (285h41m34.216809959s) [noise=true , address=185.167.204.205:4003 , piece_id=K6OZGDZPSJEY2SU7FZNFAMXXZ6XBRDZZQWKLH7JDWV2IMMXOPBEQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080093774 (285h41m34.219077958s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080863126 (285h41m34.219847321s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.083339837 (285h41m34.222324031s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.085816768 (285h41m34.224800962s) [noise=true , address=81.171.14.70:4030 , piece_id=MVNAAWHVDWEUFH3LI4OYOGIBFDA5QVMOWLAWX2T4NVCPVMXW53WQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.086581150 (285h41m34.225565344s) [noise=true , address=185.167.204.206:4044 , piece_id=K7BSTZIJZ5O3UFSUCIE2QEY73F6NS656LHCJCQOGKN6WXGYLJNDQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.089190699 (285h41m34.228174883s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.119055626 (285h41m34.258039811s) [noise=true , address=89.149.201.147:4019 , piece_id=MJ7UTA7W6D74X6SCNDPW2SGNM6GA7IMTVI4JNLTQM3M7O5HLR7BA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120683066 (285h41m34.25966725s) [noise=true , address=185.167.204.205:4015 , piece_id=TAPHD35KOHH4VYY6Z73KA5JFZT3VNFTZG4YARR6ETPGNSUSZYTWA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120920100 (285h41m34.259904314s) [noise=true , address=185.167.204.205:4014 , piece_id=YORPAGOGXFQZV44LN4YEBAQVXRBMT7H5SC2OJETJWSRU7367QSFQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.485466929 (285h41m34.624451123s) [noise=true , address=89.149.201.147:4011 , piece_id=6KVSDMMOJOVKFELYU564B6USMMTNSF2NIFL72YZWMQVG4GYJOP6A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.510639133 (285h41m34.649623327s) [noise=true , address=89.149.201.147:4013 , piece_id=MEFNG6LZ7643OHIAHDPTCMEM5QGNEGXDF524CR3T5TE7YP2EGEFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.524099082 (285h41m34.663083266s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.535501987 (285h41m34.674486181s) [noise=true , address=81.171.14.70:4046 , piece_id=HLZUT3Q52XGLGZ6JG4SYDSAJMZ2ROAN7NTHV2FUFRUERUDJUA5DA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.540435691 (285h41m34.679419885s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:51:13.974183086 (285h42m33.113167271s) [noise=true , address=185.167.204.205:4027 , piece_id=QPQDPDZXNP2OB7VNFAPFUKCWPTAHGUABFPJIVGFK22AE5WIMVOOQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection
Mar 1 17:51:13.974201662 (285h42m33.113185845s) [noise=true , address=185.167.204.206:4057 , piece_id=QIME5J2R4CUHXAMXXZH56GPFZX5FN2W5SSA4RR6ZJQ2CI23FPRKQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 5.161.89.252:48350->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:13.974291951 (285h42m33.113276134s) [noise=true , address=185.167.204.205:4004 , piece_id=QHOQGVUE7PTUJCJVC43OQMP674UVIML7COEWUPGZB7MWQKJKTKMQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 5.161.89.252:39082->185.167.204.205:4004: use of closed network connection; context deadline exceeded
Mar 1 17:51:13.974310305 (285h42m33.113294479s) [seg_pos={0 0}, upload=251212]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:14.082129983 (285h42m33.221114167s) [upload=251212]: Done uploading segments...
Mar 1 17:51:14.082167263 (285h42m33.221151447s) [upload=251212]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.215917198s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.173409ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=1898CB2FB36F3FE7 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=fCMTUauUayL Date=Sun, 01 Mar 2026 18:30:59 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4853f6032435932b
FAIL (2026-03-01 18:30:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB2FB36F3FE7</RequestId><HostId></HostId></Error>"
Duration: 23.189619ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.130051ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=F1Q57RLSGns X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1898CB2BFEBDDB16 Date=Sun, 01 Mar 2026 18:30:43 GMT Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3fc4251501c4322
FAIL (2026-03-01 18:30:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB2BFEBDDB16</RequestId><HostId></HostId></Error>"
Duration: 24.171699ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.252827ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:30:35 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1898CB2A37D44958 X-Request-Id=4VDWhQMyVGj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/557ff1782c2bb900
FAIL (2026-03-01 18:30:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB2A37D44958</RequestId><HostId></HostId></Error>"
Duration: 31.328569ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.624421205s trace:
https://jaeger.dev.storj.io/trace/6409f9bfcd59d0a0
FAIL (2026-03-01 18:30:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357343755 (285h41m33.496327949s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357767469 (285h41m33.496751663s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.358341195 (285h41m33.497325389s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.363880022 (285h41m33.502864216s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.364001479 (285h41m33.502985673s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.365332803 (285h41m33.504316998s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.366574020 (285h41m33.505558214s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.367686234 (285h41m33.506670418s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.368802976 (285h41m33.50778717s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.369883561 (285h41m33.508867745s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.372958261 (285h41m33.511942445s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.826802472 (285h41m33.965786656s) [upload=251212]: Next returned nil segment
Mar 1 17:50:14.826813533 (285h41m33.965797727s) [upload=251212]: Waiting for error group managing segments...
Mar 1 17:50:15.017217575 (285h41m34.156201759s) [noise=true , address=185.167.204.206:4058 , piece_id=Y6HEVFTQBPYNJXDC6JLVM4YRD6JJTSSFG2LFHWN2QVBK3RAJWULQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.030107146 (285h41m34.169091341s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.033619627 (285h41m34.172603811s) [noise=true , address=89.149.201.147:4010 , piece_id=I57BTZJT5CCAK7ZVH5US4J5DL3L7W7TQXRMXXZOPFXSXKIG6UBBA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.041207315 (285h41m34.180191509s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.043293673 (285h41m34.182277867s) [noise=true , address=185.167.204.205:4009 , piece_id=2TA2A3X2SS33Q5TO5RBAEZCZBFBS37MH2TWCR53QOIPLBW3GCL2Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.048398598 (285h41m34.187382782s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.058585996 (285h41m34.197570191s) [noise=true , address=81.171.14.70:4044 , piece_id=AAIXAMMRDYF5WNRS2EJSTVYHDSJDF4F3ZX6AWIMQIVVIVRQUOYLQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.064976971 (285h41m34.203961155s) [noise=true , address=81.171.14.70:4045 , piece_id=LQ3SVBUG6LRPUORF2DTJPTA7WFH5BLFYHTXF44HFKLXKBCLQTMPA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.072542085 (285h41m34.211526279s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.073558409 (285h41m34.212542603s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.077825775 (285h41m34.216809959s) [noise=true , address=185.167.204.205:4003 , piece_id=K6OZGDZPSJEY2SU7FZNFAMXXZ6XBRDZZQWKLH7JDWV2IMMXOPBEQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080093774 (285h41m34.219077958s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080863126 (285h41m34.219847321s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.083339837 (285h41m34.222324031s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.085816768 (285h41m34.224800962s) [noise=true , address=81.171.14.70:4030 , piece_id=MVNAAWHVDWEUFH3LI4OYOGIBFDA5QVMOWLAWX2T4NVCPVMXW53WQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.086581150 (285h41m34.225565344s) [noise=true , address=185.167.204.206:4044 , piece_id=K7BSTZIJZ5O3UFSUCIE2QEY73F6NS656LHCJCQOGKN6WXGYLJNDQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.089190699 (285h41m34.228174883s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.119055626 (285h41m34.258039811s) [noise=true , address=89.149.201.147:4019 , piece_id=MJ7UTA7W6D74X6SCNDPW2SGNM6GA7IMTVI4JNLTQM3M7O5HLR7BA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120683066 (285h41m34.25966725s) [noise=true , address=185.167.204.205:4015 , piece_id=TAPHD35KOHH4VYY6Z73KA5JFZT3VNFTZG4YARR6ETPGNSUSZYTWA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120920100 (285h41m34.259904314s) [noise=true , address=185.167.204.205:4014 , piece_id=YORPAGOGXFQZV44LN4YEBAQVXRBMT7H5SC2OJETJWSRU7367QSFQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.485466929 (285h41m34.624451123s) [noise=true , address=89.149.201.147:4011 , piece_id=6KVSDMMOJOVKFELYU564B6USMMTNSF2NIFL72YZWMQVG4GYJOP6A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.510639133 (285h41m34.649623327s) [noise=true , address=89.149.201.147:4013 , piece_id=MEFNG6LZ7643OHIAHDPTCMEM5QGNEGXDF524CR3T5TE7YP2EGEFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.524099082 (285h41m34.663083266s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.535501987 (285h41m34.674486181s) [noise=true , address=81.171.14.70:4046 , piece_id=HLZUT3Q52XGLGZ6JG4SYDSAJMZ2ROAN7NTHV2FUFRUERUDJUA5DA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.540435691 (285h41m34.679419885s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:51:13.974183086 (285h42m33.113167271s) [noise=true , address=185.167.204.205:4027 , piece_id=QPQDPDZXNP2OB7VNFAPFUKCWPTAHGUABFPJIVGFK22AE5WIMVOOQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection
Mar 1 17:51:13.974201662 (285h42m33.113185845s) [noise=true , address=185.167.204.206:4057 , piece_id=QIME5J2R4CUHXAMXXZH56GPFZX5FN2W5SSA4RR6ZJQ2CI23FPRKQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 5.161.89.252:48350->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:13.974291951 (285h42m33.113276134s) [noise=true , address=185.167.204.205:4004 , piece_id=QHOQGVUE7PTUJCJVC43OQMP674UVIML7COEWUPGZB7MWQKJKTKMQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 5.161.89.252:39082->185.167.204.205:4004: use of closed network connection; context deadline exceeded
Mar 1 17:51:13.974310305 (285h42m33.113294479s) [seg_pos={0 0}, upload=251212]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:14.082129983 (285h42m33.221114167s) [upload=251212]: Done uploading segments...
Mar 1 17:51:14.082167263 (285h42m33.221151447s) [upload=251212]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.624442175s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.603875ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CB265E68CA49 X-Request-Id=SUQf6nahffq X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Sun, 01 Mar 2026 18:30:19 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5cd50513c89f5e1b
FAIL (2026-03-01 18:30:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB265E68CA49</RequestId><HostId></HostId></Error>"
Duration: 12.626759ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.437816ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Request-Id=LD7ELX6jARw X-Xss-Protection=1; mode=block Content-Type=application/xml X-Amz-Request-Id=1898CB21F322C8A9 Date=Sun, 01 Mar 2026 18:30:00 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2f863c99bdd5e58e
FAIL (2026-03-01 18:30:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB21F322C8A9</RequestId><HostId></HostId></Error>"
Duration: 7.45593ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.583586ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CB2201ABD7FF X-Request-Id=EYyH2mirBbt X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:30:00 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5474e08c04ec15c4
FAIL (2026-03-01 18:30:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB2201ABD7FF</RequestId><HostId></HostId></Error>"
Duration: 23.600036ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.920877ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CB21DA2BCB26 X-Request-Id=BFzUn1YaCCX Date=Sun, 01 Mar 2026 18:29:59 GMT Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/59e6d018ac48a79b
FAIL (2026-03-01 18:29:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB21DA2BCB26</RequestId><HostId></HostId></Error>"
Duration: 22.931596ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.454333ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=AAyA6NPYWKV X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:29:59 GMT Content-Type=application/xml Server=Storj Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898CB21D837F55F target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/34f82c2665327765
FAIL (2026-03-01 18:29:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB21D837F55F</RequestId><HostId></HostId></Error>"
Duration: 23.471046ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
47.175019ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Amz-Request-Id=1898CB1DA388E324 X-Request-Id=YvdZN7UYDfR X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:29:41 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1421d43c535f3b98
FAIL (2026-03-01 18:29:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB1DA388E324</RequestId><HostId></HostId></Error>"
Duration: 47.192152ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.689426259s trace:
https://jaeger.dev.storj.io/trace/6409f9bfcd59d0a0
FAIL (2026-03-01 18:29:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357343755 (285h41m33.496327949s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357767469 (285h41m33.496751663s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.358341195 (285h41m33.497325389s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.363880022 (285h41m33.502864216s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.364001479 (285h41m33.502985673s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.365332803 (285h41m33.504316998s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.366574020 (285h41m33.505558214s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.367686234 (285h41m33.506670418s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.368802976 (285h41m33.50778717s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.369883561 (285h41m33.508867745s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.372958261 (285h41m33.511942445s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.826802472 (285h41m33.965786656s) [upload=251212]: Next returned nil segment
Mar 1 17:50:14.826813533 (285h41m33.965797727s) [upload=251212]: Waiting for error group managing segments...
Mar 1 17:50:15.017217575 (285h41m34.156201759s) [noise=true , address=185.167.204.206:4058 , piece_id=Y6HEVFTQBPYNJXDC6JLVM4YRD6JJTSSFG2LFHWN2QVBK3RAJWULQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.030107146 (285h41m34.169091341s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.033619627 (285h41m34.172603811s) [noise=true , address=89.149.201.147:4010 , piece_id=I57BTZJT5CCAK7ZVH5US4J5DL3L7W7TQXRMXXZOPFXSXKIG6UBBA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.041207315 (285h41m34.180191509s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.043293673 (285h41m34.182277867s) [noise=true , address=185.167.204.205:4009 , piece_id=2TA2A3X2SS33Q5TO5RBAEZCZBFBS37MH2TWCR53QOIPLBW3GCL2Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.048398598 (285h41m34.187382782s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.058585996 (285h41m34.197570191s) [noise=true , address=81.171.14.70:4044 , piece_id=AAIXAMMRDYF5WNRS2EJSTVYHDSJDF4F3ZX6AWIMQIVVIVRQUOYLQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.064976971 (285h41m34.203961155s) [noise=true , address=81.171.14.70:4045 , piece_id=LQ3SVBUG6LRPUORF2DTJPTA7WFH5BLFYHTXF44HFKLXKBCLQTMPA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.072542085 (285h41m34.211526279s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.073558409 (285h41m34.212542603s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.077825775 (285h41m34.216809959s) [noise=true , address=185.167.204.205:4003 , piece_id=K6OZGDZPSJEY2SU7FZNFAMXXZ6XBRDZZQWKLH7JDWV2IMMXOPBEQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080093774 (285h41m34.219077958s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080863126 (285h41m34.219847321s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.083339837 (285h41m34.222324031s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.085816768 (285h41m34.224800962s) [noise=true , address=81.171.14.70:4030 , piece_id=MVNAAWHVDWEUFH3LI4OYOGIBFDA5QVMOWLAWX2T4NVCPVMXW53WQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.086581150 (285h41m34.225565344s) [noise=true , address=185.167.204.206:4044 , piece_id=K7BSTZIJZ5O3UFSUCIE2QEY73F6NS656LHCJCQOGKN6WXGYLJNDQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.089190699 (285h41m34.228174883s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.119055626 (285h41m34.258039811s) [noise=true , address=89.149.201.147:4019 , piece_id=MJ7UTA7W6D74X6SCNDPW2SGNM6GA7IMTVI4JNLTQM3M7O5HLR7BA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120683066 (285h41m34.25966725s) [noise=true , address=185.167.204.205:4015 , piece_id=TAPHD35KOHH4VYY6Z73KA5JFZT3VNFTZG4YARR6ETPGNSUSZYTWA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120920100 (285h41m34.259904314s) [noise=true , address=185.167.204.205:4014 , piece_id=YORPAGOGXFQZV44LN4YEBAQVXRBMT7H5SC2OJETJWSRU7367QSFQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.485466929 (285h41m34.624451123s) [noise=true , address=89.149.201.147:4011 , piece_id=6KVSDMMOJOVKFELYU564B6USMMTNSF2NIFL72YZWMQVG4GYJOP6A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.510639133 (285h41m34.649623327s) [noise=true , address=89.149.201.147:4013 , piece_id=MEFNG6LZ7643OHIAHDPTCMEM5QGNEGXDF524CR3T5TE7YP2EGEFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.524099082 (285h41m34.663083266s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.535501987 (285h41m34.674486181s) [noise=true , address=81.171.14.70:4046 , piece_id=HLZUT3Q52XGLGZ6JG4SYDSAJMZ2ROAN7NTHV2FUFRUERUDJUA5DA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.540435691 (285h41m34.679419885s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:51:13.974183086 (285h42m33.113167271s) [noise=true , address=185.167.204.205:4027 , piece_id=QPQDPDZXNP2OB7VNFAPFUKCWPTAHGUABFPJIVGFK22AE5WIMVOOQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection
Mar 1 17:51:13.974201662 (285h42m33.113185845s) [noise=true , address=185.167.204.206:4057 , piece_id=QIME5J2R4CUHXAMXXZH56GPFZX5FN2W5SSA4RR6ZJQ2CI23FPRKQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 5.161.89.252:48350->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:13.974291951 (285h42m33.113276134s) [noise=true , address=185.167.204.205:4004 , piece_id=QHOQGVUE7PTUJCJVC43OQMP674UVIML7COEWUPGZB7MWQKJKTKMQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 5.161.89.252:39082->185.167.204.205:4004: use of closed network connection; context deadline exceeded
Mar 1 17:51:13.974310305 (285h42m33.113294479s) [seg_pos={0 0}, upload=251212]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:14.082129983 (285h42m33.221114167s) [upload=251212]: Done uploading segments...
Mar 1 17:51:14.082167263 (285h42m33.221151447s) [upload=251212]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.689440507s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.216788ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Sun, 01 Mar 2026 18:29:28 GMT Content-Length=284 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CB1AB12E6051 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=gHizvMGQ5B2 X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/265ac6f13e8c0460
FAIL (2026-03-01 18:29:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB1AB12E6051</RequestId><HostId></HostId></Error>"
Duration: 17.235514ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.981807ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=KrG3LNpuUu9 X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:29:20 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=1898CB18C6DB4289 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/162cf1db0788a97f
FAIL (2026-03-01 18:29:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB18C6DB4289</RequestId><HostId></HostId></Error>"
Duration: 24.998218ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.926956ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block X-Amz-Request-Id=1898CB16CDD7BDF5 Date=Sun, 01 Mar 2026 18:29:12 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=QX7cZS4c4FS target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/236df27d558008f2
FAIL (2026-03-01 18:29:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB16CDD7BDF5</RequestId><HostId></HostId></Error>"
Duration: 22.942776ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.48949ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 01 Mar 2026 18:29:00 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1898CB140632ACA2 X-Request-Id=aBJ92Bf7S9D X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/21875d1c602e2200
FAIL (2026-03-01 18:29:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB140632ACA2</RequestId><HostId></HostId></Error>"
Duration: 23.509347ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
33.93456ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=BcWMsEygSck X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:28:43 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=1898CB1035A97BEA target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/21849c0df998abdc
FAIL (2026-03-01 18:28:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB1035A97BEA</RequestId><HostId></HostId></Error>"
Duration: 33.946303ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.899883ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=DSkirEeLdZi X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=1898CB0F14A827E4 Date=Sun, 01 Mar 2026 18:28:39 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5013e149969a5702
FAIL (2026-03-01 18:28:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB0F14A827E4</RequestId><HostId></HostId></Error>"
Duration: 13.91932ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.329204897s trace:
https://jaeger.dev.storj.io/trace/6409f9bfcd59d0a0
FAIL (2026-03-01 18:28:32 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357343755 (285h41m33.496327949s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.357767469 (285h41m33.496751663s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.358341195 (285h41m33.497325389s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.363880022 (285h41m33.502864216s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.364001479 (285h41m33.502985673s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.365332803 (285h41m33.504316998s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.366574020 (285h41m33.505558214s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.367686234 (285h41m33.506670418s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.368802976 (285h41m33.50778717s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.369883561 (285h41m33.508867745s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.372958261 (285h41m33.511942445s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Uploading piece...
Mar 1 17:50:14.826802472 (285h41m33.965786656s) [upload=251212]: Next returned nil segment
Mar 1 17:50:14.826813533 (285h41m33.965797727s) [upload=251212]: Waiting for error group managing segments...
Mar 1 17:50:15.017217575 (285h41m34.156201759s) [noise=true , address=185.167.204.206:4058 , piece_id=Y6HEVFTQBPYNJXDC6JLVM4YRD6JJTSSFG2LFHWN2QVBK3RAJWULQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.030107146 (285h41m34.169091341s) [noise=true , address=185.167.204.205:4023 , piece_id=WKQTD3U6ZWSCY3GJRSQ3M66WLTZMHES3PZSHVHH5HYAXTSD65GFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.033619627 (285h41m34.172603811s) [noise=true , address=89.149.201.147:4010 , piece_id=I57BTZJT5CCAK7ZVH5US4J5DL3L7W7TQXRMXXZOPFXSXKIG6UBBA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.041207315 (285h41m34.180191509s) [noise=true , address=185.167.204.205:4005 , piece_id=ZNF2MTU2TPP6777EY7ALKKKO5GI4TKGMHSBNIFAUGB6JXIOYUZCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.043293673 (285h41m34.182277867s) [noise=true , address=185.167.204.205:4009 , piece_id=2TA2A3X2SS33Q5TO5RBAEZCZBFBS37MH2TWCR53QOIPLBW3GCL2Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.048398598 (285h41m34.187382782s) [noise=true , address=89.149.201.147:4004 , piece_id=JONXSGNPMZAMTJIJPBE3AG476F6RTBE64NX36WF5BPJZOVOFQLUQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.058585996 (285h41m34.197570191s) [noise=true , address=81.171.14.70:4044 , piece_id=AAIXAMMRDYF5WNRS2EJSTVYHDSJDF4F3ZX6AWIMQIVVIVRQUOYLQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.064976971 (285h41m34.203961155s) [noise=true , address=81.171.14.70:4045 , piece_id=LQ3SVBUG6LRPUORF2DTJPTA7WFH5BLFYHTXF44HFKLXKBCLQTMPA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.072542085 (285h41m34.211526279s) [noise=true , address=89.149.201.147:4014 , piece_id=C52WENAERNHVVLF3CAZEIOOQUKDIRC6US4PLVJ42UW2WQAOCAEQA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.073558409 (285h41m34.212542603s) [noise=true , address=81.171.14.70:4033 , piece_id=VV2V6PSPICOL4VFQXFNY77N7GGWTVWRUJI4RJWFDDFXAOAPDMWVQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.077825775 (285h41m34.216809959s) [noise=true , address=185.167.204.205:4003 , piece_id=K6OZGDZPSJEY2SU7FZNFAMXXZ6XBRDZZQWKLH7JDWV2IMMXOPBEQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080093774 (285h41m34.219077958s) [noise=true , address=185.167.204.206:4037 , piece_id=DDS476ULVMSRZVRV7GP4R47RL3O7DHFNJPXJICHRKUY3RDDEVM3Q, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.080863126 (285h41m34.219847321s) [noise=true , address=81.171.14.70:4047 , piece_id=A6NQ4BCN5IT6FGD33BSDCAHMUGQ7VOH7IPTHNICVPKEB675L7RQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.083339837 (285h41m34.222324031s) [noise=true , address=81.171.14.70:4048 , piece_id=ECGPG5RXA3GE7LWHRSGRQ4WAR63LMHVU3AWWTTGPYANKW3DVEUQQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.085816768 (285h41m34.224800962s) [noise=true , address=81.171.14.70:4030 , piece_id=MVNAAWHVDWEUFH3LI4OYOGIBFDA5QVMOWLAWX2T4NVCPVMXW53WQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.086581150 (285h41m34.225565344s) [noise=true , address=185.167.204.206:4044 , piece_id=K7BSTZIJZ5O3UFSUCIE2QEY73F6NS656LHCJCQOGKN6WXGYLJNDQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.089190699 (285h41m34.228174883s) [noise=true , address=81.171.14.70:4034 , piece_id=ZYMXH2RXOOBB7Q4ZTHVDBHA6TCYJ3G7EZR5PNQRBKFPTIDNQZGAA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.119055626 (285h41m34.258039811s) [noise=true , address=89.149.201.147:4019 , piece_id=MJ7UTA7W6D74X6SCNDPW2SGNM6GA7IMTVI4JNLTQM3M7O5HLR7BA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120683066 (285h41m34.25966725s) [noise=true , address=185.167.204.205:4015 , piece_id=TAPHD35KOHH4VYY6Z73KA5JFZT3VNFTZG4YARR6ETPGNSUSZYTWA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.120920100 (285h41m34.259904314s) [noise=true , address=185.167.204.205:4014 , piece_id=YORPAGOGXFQZV44LN4YEBAQVXRBMT7H5SC2OJETJWSRU7367QSFQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.485466929 (285h41m34.624451123s) [noise=true , address=89.149.201.147:4011 , piece_id=6KVSDMMOJOVKFELYU564B6USMMTNSF2NIFL72YZWMQVG4GYJOP6A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.510639133 (285h41m34.649623327s) [noise=true , address=89.149.201.147:4013 , piece_id=MEFNG6LZ7643OHIAHDPTCMEM5QGNEGXDF524CR3T5TE7YP2EGEFA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.524099082 (285h41m34.663083266s) [noise=true , address=89.149.201.147:4023 , piece_id=MEDRAJWCTL2MGK5OPC25BLWFM2ZRMPZJONBNLXL5DBK4VJKGUG3A, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.535501987 (285h41m34.674486181s) [noise=true , address=81.171.14.70:4046 , piece_id=HLZUT3Q52XGLGZ6JG4SYDSAJMZ2ROAN7NTHV2FUFRUERUDJUA5DA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:50:15.540435691 (285h41m34.679419885s) [noise=true , address=81.171.14.70:4043 , piece_id=6DGB34S2MEFABFXEWQL7XI2AGH4LPJSHNDJSJF5RHAFBINMPRXCA, seg_pos={0 0}, upload=251212]: Done uploading piece. err: <nil>
Mar 1 17:51:13.974183086 (285h42m33.113167271s) [noise=true , address=185.167.204.205:4027 , piece_id=QPQDPDZXNP2OB7VNFAPFUKCWPTAHGUABFPJIVGFK22AE5WIMVOOQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1CVzMfvFN4cYHWnSVrXBmHjLR9KtGqsMimwVq1QJzjgpbjeszV, address:185.167.204.205:4027): protocol: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:30240->185.167.204.205:4027: use of closed network connection
Mar 1 17:51:13.974201662 (285h42m33.113185845s) [noise=true , address=185.167.204.206:4057 , piece_id=QIME5J2R4CUHXAMXXZH56GPFZX5FN2W5SSA4RR6ZJQ2CI23FPRKQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: read tcp 5.161.89.252:48350->185.167.204.206:4057: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 1 17:51:13.974291951 (285h42m33.113276134s) [noise=true , address=185.167.204.205:4004 , piece_id=QHOQGVUE7PTUJCJVC43OQMP674UVIML7COEWUPGZB7MWQKJKTKMQ, seg_pos={0 0}, upload=251212]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: read tcp 5.161.89.252:39082->185.167.204.205:4004: use of closed network connection; context deadline exceeded
Mar 1 17:51:13.974310305 (285h42m33.113294479s) [seg_pos={0 0}, upload=251212]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 1 17:51:14.082129983 (285h42m33.221114167s) [upload=251212]: Done uploading segments...
Mar 1 17:51:14.082167263 (285h42m33.221151447s) [upload=251212]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.329223922s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.499542ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1898CB0B347FCEA3 X-Request-Id=eYvqUHcpRBA Date=Sun, 01 Mar 2026 18:28:22 GMT Accept-Ranges=bytes Content-Length=284 Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/2b731fac00b8c375
FAIL (2026-03-01 18:28:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB0B347FCEA3</RequestId><HostId></HostId></Error>"
Duration: 7.517285ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.224832ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1898CB09A422D94F X-Request-Id=AFfMh4GNzFh X-Xss-Protection=1; mode=block Date=Sun, 01 Mar 2026 18:28:15 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/676cbfa0de0ee3c2
FAIL (2026-03-01 18:28:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1898CB09A422D94F</RequestId><HostId></HostId></Error>"
Duration: 22.240051ms
edge
gateway
vhost
bgp
ap1
|