Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.695541ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18AA03858D0F7612 X-Request-Id=LKumadsiXeL X-Xss-Protection=1; mode=block Server=Storj Date=Sun, 26 Apr 2026 20:54:35 GMT Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/640487ed331f9d0c
FAIL (2026-04-26 20:54:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03858D0F7612</RequestId><HostId></HostId></Error>"
Duration: 7.711481ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
106.736176ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18AA0382134280E6 X-Request-Id=iKDtX27bnw7 Date=Sun, 26 Apr 2026 20:54:20 GMT Content-Type=application/xml X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6eaab805e31fceef
FAIL (2026-04-26 20:54:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0382134280E6</RequestId><HostId></HostId></Error>"
Duration: 106.756044ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
6 out of 60 is failed (threshold=3) [....................XX..................X..XX..X............] duration:
1.11571074s trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:54:09 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060 , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957 , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486 , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1.115727811s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.668056ms remote:
"tcp:79.127.223.133:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=18AA037F4ABB79CC X-Request-Id=AexrK9mhhYN X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:54:08 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/ce21dd0bd1babf7
FAIL (2026-04-26 20:54:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA037F4ABB79CC</RequestId><HostId></HostId></Error>"
Duration: 17.679509ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
111.234666ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=SbqBNLvnFoR Date=Sun, 26 Apr 2026 20:53:58 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18AA037CF5F264B7 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4a6f9ef8ab0987ce
FAIL (2026-04-26 20:53:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA037CF5F264B7</RequestId><HostId></HostId></Error>"
Duration: 111.249784ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
117.770051ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin X-Request-Id=4gnoKA7BbfF Date=Sun, 26 Apr 2026 20:53:50 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18AA037B3653E9D5 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6414bb41459b47eb
FAIL (2026-04-26 20:53:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA037B3653E9D5</RequestId><HostId></HostId></Error>"
Duration: 117.786632ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
107.196067ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18AA0379C53D7903 X-Request-Id=9ruwgpPJLiB Accept-Ranges=bytes X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:53:44 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/16bc4c8517dfe77a
FAIL (2026-04-26 20:53:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0379C53D7903</RequestId><HostId></HostId></Error>"
Duration: 107.211185ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
111.231579ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Date=Sun, 26 Apr 2026 20:53:21 GMT Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18AA03746B4E342C X-Request-Id=VnrJG7JfSpH target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/13f771a0ede646ae
FAIL (2026-04-26 20:53:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03746B4E342C</RequestId><HostId></HostId></Error>"
Duration: 111.244203ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....................XX..................X..XX..X...........] duration:
564.785562ms trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:53:18 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060 , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957 , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486 , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 564.80639ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.177048ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18AA0371D5BA5F8C X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:53:10 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=KAAW8imCU43 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6529cd2118864c35
FAIL (2026-04-26 20:53:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0371D5BA5F8C</RequestId><HostId></HostId></Error>"
Duration: 7.192608ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
129.901804ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18AA036FC87FD754 Date=Sun, 26 Apr 2026 20:53:01 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Request-Id=KyFTm2tNHK7 X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/636a810c48a1625c
FAIL (2026-04-26 20:53:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA036FC87FD754</RequestId><HostId></HostId></Error>"
Duration: 129.918344ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
107.177353ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18AA036E5DCD9140 Date=Sun, 26 Apr 2026 20:52:55 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=MEX7KfZsGGP target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/f9b4437b31a16aa
FAIL (2026-04-26 20:52:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA036E5DCD9140</RequestId><HostId></HostId></Error>"
Duration: 107.195507ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.007218ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18AA036AC0BC0A5E Date=Sun, 26 Apr 2026 20:52:39 GMT Server=Storj Vary=Origin X-Request-Id=rWjMU9hbE2 X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3222364207e7c61
FAIL (2026-04-26 20:52:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA036AC0BC0A5E</RequestId><HostId></HostId></Error>"
Duration: 17.022278ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
119.875607ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Request-Id=gHvufAt5csg Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18AA0369E431F85D X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:52:36 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6d461047d6b058f2
FAIL (2026-04-26 20:52:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0369E431F85D</RequestId><HostId></HostId></Error>"
Duration: 119.895614ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
6 out of 60 is failed (threshold=3) [......................XX..................X..XX..X..........] duration:
2.744333038s trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:52:20 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060 , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957 , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486 , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.744350851s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
112.488172ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18AA0364F6A6B6F9 X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:52:15 GMT Content-Type=application/xml Server=Storj X-Request-Id=Uc265y63mkE target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/e29da779469c97a
FAIL (2026-04-26 20:52:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0364F6A6B6F9</RequestId><HostId></HostId></Error>"
Duration: 112.504782ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
111.392412ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Date=Sun, 26 Apr 2026 20:52:13 GMT Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=18AA036481531B8D X-Request-Id=9iaBWMKaLbd X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/444c9293063d690e
FAIL (2026-04-26 20:52:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA036481531B8D</RequestId><HostId></HostId></Error>"
Duration: 111.408632ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
111.122465ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 26 Apr 2026 20:52:12 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18AA0364538F0135 X-Request-Id=7dmJ8Ya9ets X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1f5deea0bf2738d8
FAIL (2026-04-26 20:52:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0364538F0135</RequestId><HostId></HostId></Error>"
Duration: 111.138255ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
112.72102ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=18AA035D78E47D54 X-Request-Id=ag7c3JDhGB3 X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:51:42 GMT Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/417151fa62f7d391
FAIL (2026-04-26 20:51:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA035D78E47D54</RequestId><HostId></HostId></Error>"
Duration: 112.743963ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.360188ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18AA035BFE11427D X-Request-Id=AQeYiBJjc14 X-Xss-Protection=1; mode=block Server=Storj Date=Sun, 26 Apr 2026 20:51:36 GMT Accept-Ranges=bytes Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7f76bfd18e1cbf4e
FAIL (2026-04-26 20:51:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA035BFE11427D</RequestId><HostId></HostId></Error>"
Duration: 14.380126ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......................XX..................X..XX..X.........] duration:
1.576083589s trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:51:34 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060 , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957 , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486 , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1.576099099s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
110.059032ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 X-Request-Id=SFKC6byQsBJ X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18AA035B6F1CD223 Date=Sun, 26 Apr 2026 20:51:34 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/39c6c9227b348cea
FAIL (2026-04-26 20:51:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA035B6F1CD223</RequestId><HostId></HostId></Error>"
Duration: 110.068871ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
107.967262ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=eCou8WdzJCS X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:51:14 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18AA0356F6CC924F target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/531a91c46456dcb1
FAIL (2026-04-26 20:51:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0356F6CC924F</RequestId><HostId></HostId></Error>"
Duration: 107.982981ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
123.481483ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18AA0355950165CB X-Request-Id=hTexbEcUpfT Content-Length=274 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:51:09 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4000987dddece3ea
FAIL (2026-04-26 20:51:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0355950165CB</RequestId><HostId></HostId></Error>"
Duration: 123.503034ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
110.455674ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18AA0350994E02F0 X-Request-Id=XECe2BWmMzF X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:50:47 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2fbdbe3a60e84f6a
FAIL (2026-04-26 20:50:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0350994E02F0</RequestId><HostId></HostId></Error>"
Duration: 110.472295ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
107.316432ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18AA0350274F4D2F X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=TSfqSDH5JTA Date=Sun, 26 Apr 2026 20:50:45 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5ca4cd5940f662f1
FAIL (2026-04-26 20:50:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0350274F4D2F</RequestId><HostId></HostId></Error>"
Duration: 107.331901ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
110.820702ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=AXss48JjRZE X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18AA034DCEB93B63 Date=Sun, 26 Apr 2026 20:50:35 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/38ceac98cd060ab2
FAIL (2026-04-26 20:50:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA034DCEB93B63</RequestId><HostId></HostId></Error>"
Duration: 110.854676ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.586049ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18AA034CAD067997 X-Request-Id=aWafTLsMKr4 Date=Sun, 26 Apr 2026 20:50:30 GMT Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/31a03205bc5a0526
FAIL (2026-04-26 20:50:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA034CAD067997</RequestId><HostId></HostId></Error>"
Duration: 11.596058ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
6 out of 60 is failed (threshold=3) [........................XX..................X..XX..X........] duration:
951.821709ms trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:50:28 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060 , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957 , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486 , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 951.840614ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
131.690916ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Date=Sun, 26 Apr 2026 20:50:11 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18AA034811F86136 X-Request-Id=LyD2wU8oLf9 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/70d488c333f0bd8b
FAIL (2026-04-26 20:50:11 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA034811F86136</RequestId><HostId></HostId></Error>"
Duration: 131.706775ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
106.920622ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18AA0343281F6CEE Accept-Ranges=bytes Server=Storj X-Request-Id=HwSuqKnd2LC X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:49:49 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6c3f7e328df12a7d
FAIL (2026-04-26 20:49:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0343281F6CEE</RequestId><HostId></HostId></Error>"
Duration: 106.939146ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
108.87362ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:49:47 GMT Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=18AA03427ABA44EB X-Request-Id=NNTjE9kb9Xm Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7ab017fec1ffb420
FAIL (2026-04-26 20:49:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03427ABA44EB</RequestId><HostId></HostId></Error>"
Duration: 108.888548ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........................XX..................X..XX..X.......] duration:
964.050896ms trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:49:36 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060 , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957 , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486 , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 964.06893ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
112.986437ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18AA033F705C8750 X-Request-Id=gSSyXd1DFaU X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj Vary=Origin Date=Sun, 26 Apr 2026 20:49:33 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3c05619947811df
FAIL (2026-04-26 20:49:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033F705C8750</RequestId><HostId></HostId></Error>"
Duration: 113.000584ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
117.329806ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18AA033CE83E9610 X-Request-Id=C3aZ1Yu3ou3 X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:49:23 GMT Content-Length=274 Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3afc41aa7316e6f3
FAIL (2026-04-26 20:49:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033CE83E9610</RequestId><HostId></HostId></Error>"
Duration: 117.349262ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
106.820504ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=18AA033C78F6474D X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:49:21 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=3yfAPoA86H9 Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3964bbf08759ea2
FAIL (2026-04-26 20:49:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033C78F6474D</RequestId><HostId></HostId></Error>"
Duration: 106.839881ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.403489ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Date=Sun, 26 Apr 2026 20:49:20 GMT Content-Length=284 Content-Type=application/xml X-Amz-Request-Id=18AA033C61271227 X-Request-Id=vMJWxXCVXW X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5ea7a7ccc15f6e6c
FAIL (2026-04-26 20:49:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033C61271227</RequestId><HostId></HostId></Error>"
Duration: 14.423076ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
106.567242ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18AA0339D91A1E17 X-Request-Id=gUNUecJhu9V X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:49:09 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5fd690b30dd13b13
FAIL (2026-04-26 20:49:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0339D91A1E17</RequestId><HostId></HostId></Error>"
Duration: 106.583523ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........................XX..................X..XX..X......] duration:
1.111604035s trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:49:07 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060 , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957 , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486 , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1.111624393s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........................XX..................X..XX..X.....] duration:
688.56836ms trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:48:48 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060 , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957 , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486 , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 688.593508ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
109.92051ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18AA0333DF969ABF Accept-Ranges=bytes Content-Length=274 Server=Storj X-Request-Id=2SgiDEEPr4q X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:48:44 GMT Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7be901d8ba1ce1d6
FAIL (2026-04-26 20:48:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0333DF969ABF</RequestId><HostId></HostId></Error>"
Duration: 109.938144ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
107.671668ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=J3b3T3vcrYp Content-Length=274 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:48:42 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18AA033369DEE89E target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3925df9d9040aae0
FAIL (2026-04-26 20:48:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033369DEE89E</RequestId><HostId></HostId></Error>"
Duration: 107.691625ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
109.995994ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sun, 26 Apr 2026 20:48:37 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18AA033262CB41EA X-Request-Id=EhgqzX3vkVu target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6f4897b902144a74
FAIL (2026-04-26 20:48:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033262CB41EA</RequestId><HostId></HostId></Error>"
Duration: 110.010942ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.384399ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=jFeiBQcJQvr Date=Sun, 26 Apr 2026 20:48:08 GMT X-Amz-Request-Id=18AA032B7AF69B85 X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/29fd9956b35206f2
FAIL (2026-04-26 20:48:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA032B7AF69B85</RequestId><HostId></HostId></Error>"
Duration: 13.404928ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
110.448815ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=18AA03263C769285 X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:47:45 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=DHcrm2v2y64 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1d960c5e667cd29b
FAIL (2026-04-26 20:47:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03263C769285</RequestId><HostId></HostId></Error>"
Duration: 110.471587ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
6 out of 60 is failed (threshold=3) [............................XX..................X..XX..X....] duration:
1.216905929s trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:47:39 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778 , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579 , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060 , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985 , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909 , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022 , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293 , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019 , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210 , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957 , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668 , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486 , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781 , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968 , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502 , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475 , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046 , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1.216925475s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
108.22253ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=5711H5wyXYf X-Xss-Protection=1; mode=block Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=18AA0324888CD198 Date=Sun, 26 Apr 2026 20:47:38 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/29f977c11971d5bc
FAIL (2026-04-26 20:47:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0324888CD198</RequestId><HostId></HostId></Error>"
Duration: 108.238009ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
173.449174ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=18AA03233380CC07 Date=Sun, 26 Apr 2026 20:47:32 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=Ztn1FG7eu76 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/494d82536073bbf1
FAIL (2026-04-26 20:47:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03233380CC07</RequestId><HostId></HostId></Error>"
Duration: 173.466327ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
16.910437ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Type=application/xml Vary=Origin Content-Length=284 Server=Storj X-Amz-Request-Id=18AA031FC0A2B6C1 X-Request-Id=ZnK19Gexz5Q X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:47:17 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/b07a46d30006846
FAIL (2026-04-26 20:47:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA031FC0A2B6C1</RequestId><HostId></HostId></Error>"
Duration: 16.928713ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
105.429195ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18AA031ED04D7A5D X-Request-Id=HzeHqNaZGQQ X-Xss-Protection=1; mode=block Date=Sun, 26 Apr 2026 20:47:13 GMT Content-Length=274 Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/36ab75bc1740d310
FAIL (2026-04-26 20:47:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA031ED04D7A5D</RequestId><HostId></HostId></Error>"
Duration: 105.447349ms
edge
gateway
vhost
bgp
eu1
|