Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 671699 reports (Page 371 of 13434)
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
7.695541ms
remote:
"tcp:79.127.223.133:443"
response headers:
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18AA03858D0F7612
X-Request-Id=LKumadsiXeL
X-Xss-Protection=1; mode=block
Server=Storj
Date=Sun, 26 Apr 2026 20:54:35 GMT
Accept-Ranges=bytes
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/640487ed331f9d0c
FAIL (2026-04-26 20:54:35 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03858D0F7612</RequestId><HostId></HostId></Error>"
Duration: 7.711481ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
106.736176ms
remote:
"tcp:136.0.77.3:443"
response headers:
Vary=Origin
X-Amz-Request-Id=18AA0382134280E6
X-Request-Id=iKDtX27bnw7
Date=Sun, 26 Apr 2026 20:54:20 GMT
Content-Type=application/xml
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/6eaab805e31fceef
FAIL (2026-04-26 20:54:20 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0382134280E6</RequestId><HostId></HostId></Error>"
Duration: 106.756044ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [....................XX..................X..XX..X............]
duration:
1.11571074s
trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:54:09 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060     , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957     , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486    , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1.115727811s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
17.668056ms
remote:
"tcp:79.127.223.133:443"
response headers:
Server=Storj
Vary=Origin
X-Amz-Request-Id=18AA037F4ABB79CC
X-Request-Id=AexrK9mhhYN
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:54:08 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Content-Length=284
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/ce21dd0bd1babf7
FAIL (2026-04-26 20:54:08 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA037F4ABB79CC</RequestId><HostId></HostId></Error>"
Duration: 17.679509ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
111.234666ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Request-Id=SbqBNLvnFoR
Date=Sun, 26 Apr 2026 20:53:58 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Xss-Protection=1; mode=block
Content-Length=274
Content-Type=application/xml
X-Amz-Request-Id=18AA037CF5F264B7
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/4a6f9ef8ab0987ce
FAIL (2026-04-26 20:53:58 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA037CF5F264B7</RequestId><HostId></HostId></Error>"
Duration: 111.249784ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
117.770051ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Xss-Protection=1; mode=block
Content-Type=application/xml
Vary=Origin
X-Request-Id=4gnoKA7BbfF
Date=Sun, 26 Apr 2026 20:53:50 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=18AA037B3653E9D5
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/6414bb41459b47eb
FAIL (2026-04-26 20:53:50 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA037B3653E9D5</RequestId><HostId></HostId></Error>"
Duration: 117.786632ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
107.196067ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Amz-Request-Id=18AA0379C53D7903
X-Request-Id=9ruwgpPJLiB
Accept-Ranges=bytes
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:53:44 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/16bc4c8517dfe77a
FAIL (2026-04-26 20:53:44 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0379C53D7903</RequestId><HostId></HostId></Error>"
Duration: 107.211185ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
111.231579ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
Date=Sun, 26 Apr 2026 20:53:21 GMT
Content-Length=274
Content-Type=application/xml
X-Amz-Request-Id=18AA03746B4E342C
X-Request-Id=VnrJG7JfSpH
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/13f771a0ede646ae
FAIL (2026-04-26 20:53:21 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03746B4E342C</RequestId><HostId></HostId></Error>"
Duration: 111.244203ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [.....................XX..................X..XX..X...........]
duration:
564.785562ms
trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:53:18 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060     , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957     , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486    , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 564.80639ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
7.177048ms
remote:
"tcp:79.127.223.133:443"
response headers:
Accept-Ranges=bytes
Content-Length=284
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18AA0371D5BA5F8C
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:53:10 GMT
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Request-Id=KAAW8imCU43
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/6529cd2118864c35
FAIL (2026-04-26 20:53:10 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0371D5BA5F8C</RequestId><HostId></HostId></Error>"
Duration: 7.192608ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
129.901804ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Amz-Request-Id=18AA036FC87FD754
Date=Sun, 26 Apr 2026 20:53:01 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
X-Request-Id=KyFTm2tNHK7
X-Xss-Protection=1; mode=block
Content-Length=274
Content-Type=application/xml
Server=Storj
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/636a810c48a1625c
FAIL (2026-04-26 20:53:01 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA036FC87FD754</RequestId><HostId></HostId></Error>"
Duration: 129.918344ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
107.177353ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=18AA036E5DCD9140
Date=Sun, 26 Apr 2026 20:52:55 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Server=Storj
X-Request-Id=MEX7KfZsGGP
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/f9b4437b31a16aa
FAIL (2026-04-26 20:52:55 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA036E5DCD9140</RequestId><HostId></HostId></Error>"
Duration: 107.195507ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
17.007218ms
remote:
"tcp:79.127.223.133:443"
response headers:
Accept-Ranges=bytes
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=18AA036AC0BC0A5E
Date=Sun, 26 Apr 2026 20:52:39 GMT
Server=Storj
Vary=Origin
X-Request-Id=rWjMU9hbE2
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/3222364207e7c61
FAIL (2026-04-26 20:52:39 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA036AC0BC0A5E</RequestId><HostId></HostId></Error>"
Duration: 17.022278ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
119.875607ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
X-Request-Id=gHvufAt5csg
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=18AA0369E431F85D
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:52:36 GMT
Accept-Ranges=bytes
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/6d461047d6b058f2
FAIL (2026-04-26 20:52:36 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0369E431F85D</RequestId><HostId></HostId></Error>"
Duration: 119.895614ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [......................XX..................X..XX..X..........]
duration:
2.744333038s
trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:52:20 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060     , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957     , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486    , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 2.744350851s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
112.488172ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=18AA0364F6A6B6F9
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:52:15 GMT
Content-Type=application/xml
Server=Storj
X-Request-Id=Uc265y63mkE
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/e29da779469c97a
FAIL (2026-04-26 20:52:15 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0364F6A6B6F9</RequestId><HostId></HostId></Error>"
Duration: 112.504782ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
111.392412ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Date=Sun, 26 Apr 2026 20:52:13 GMT
Content-Length=274
Server=Storj
Vary=Origin
X-Amz-Request-Id=18AA036481531B8D
X-Request-Id=9iaBWMKaLbd
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/444c9293063d690e
FAIL (2026-04-26 20:52:13 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA036481531B8D</RequestId><HostId></HostId></Error>"
Duration: 111.408632ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
111.122465ms
remote:
"tcp:136.0.77.3:443"
response headers:
Date=Sun, 26 Apr 2026 20:52:12 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=18AA0364538F0135
X-Request-Id=7dmJ8Ya9ets
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Type=application/xml
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/1f5deea0bf2738d8
FAIL (2026-04-26 20:52:12 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0364538F0135</RequestId><HostId></HostId></Error>"
Duration: 111.138255ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
112.72102ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Accept-Ranges=bytes
Content-Length=274
Server=Storj
Vary=Origin
X-Amz-Request-Id=18AA035D78E47D54
X-Request-Id=ag7c3JDhGB3
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:51:42 GMT
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/417151fa62f7d391
FAIL (2026-04-26 20:51:42 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA035D78E47D54</RequestId><HostId></HostId></Error>"
Duration: 112.743963ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
14.360188ms
remote:
"tcp:79.127.223.133:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18AA035BFE11427D
X-Request-Id=AQeYiBJjc14
X-Xss-Protection=1; mode=block
Server=Storj
Date=Sun, 26 Apr 2026 20:51:36 GMT
Accept-Ranges=bytes
Content-Length=284
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/7f76bfd18e1cbf4e
FAIL (2026-04-26 20:51:36 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA035BFE11427D</RequestId><HostId></HostId></Error>"
Duration: 14.380126ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [.......................XX..................X..XX..X.........]
duration:
1.576083589s
trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:51:34 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060     , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957     , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486    , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1.576099099s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
110.059032ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
X-Request-Id=SFKC6byQsBJ
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18AA035B6F1CD223
Date=Sun, 26 Apr 2026 20:51:34 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/39c6c9227b348cea
FAIL (2026-04-26 20:51:34 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA035B6F1CD223</RequestId><HostId></HostId></Error>"
Duration: 110.068871ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
107.967262ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Request-Id=eCou8WdzJCS
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:51:14 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
Content-Length=274
Content-Type=application/xml
X-Amz-Request-Id=18AA0356F6CC924F
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/531a91c46456dcb1
FAIL (2026-04-26 20:51:15 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0356F6CC924F</RequestId><HostId></HostId></Error>"
Duration: 107.982981ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
123.481483ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Amz-Request-Id=18AA0355950165CB
X-Request-Id=hTexbEcUpfT
Content-Length=274
Content-Type=application/xml
Vary=Origin
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:51:09 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/4000987dddece3ea
FAIL (2026-04-26 20:51:09 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0355950165CB</RequestId><HostId></HostId></Error>"
Duration: 123.503034ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
110.455674ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18AA0350994E02F0
X-Request-Id=XECe2BWmMzF
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:50:47 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/2fbdbe3a60e84f6a
FAIL (2026-04-26 20:50:47 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0350994E02F0</RequestId><HostId></HostId></Error>"
Duration: 110.472295ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
107.316432ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18AA0350274F4D2F
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Request-Id=TSfqSDH5JTA
Date=Sun, 26 Apr 2026 20:50:45 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/5ca4cd5940f662f1
FAIL (2026-04-26 20:50:45 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0350274F4D2F</RequestId><HostId></HostId></Error>"
Duration: 107.331901ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
110.820702ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Request-Id=AXss48JjRZE
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18AA034DCEB93B63
Date=Sun, 26 Apr 2026 20:50:35 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/38ceac98cd060ab2
FAIL (2026-04-26 20:50:35 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA034DCEB93B63</RequestId><HostId></HostId></Error>"
Duration: 110.854676ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.586049ms
remote:
"tcp:79.127.223.133:443"
response headers:
Accept-Ranges=bytes
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=18AA034CAD067997
X-Request-Id=aWafTLsMKr4
Date=Sun, 26 Apr 2026 20:50:30 GMT
Content-Type=application/xml
Server=Storj
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/31a03205bc5a0526
FAIL (2026-04-26 20:50:30 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA034CAD067997</RequestId><HostId></HostId></Error>"
Duration: 11.596058ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [........................XX..................X..XX..X........]
duration:
951.821709ms
trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:50:28 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060     , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957     , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486    , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 951.840614ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
131.690916ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Type=application/xml
Date=Sun, 26 Apr 2026 20:50:11 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=18AA034811F86136
X-Request-Id=LyD2wU8oLf9
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/70d488c333f0bd8b
FAIL (2026-04-26 20:50:11 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA034811F86136</RequestId><HostId></HostId></Error>"
Duration: 131.706775ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
106.920622ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18AA0343281F6CEE
Accept-Ranges=bytes
Server=Storj
X-Request-Id=HwSuqKnd2LC
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:49:49 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/6c3f7e328df12a7d
FAIL (2026-04-26 20:49:49 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0343281F6CEE</RequestId><HostId></HostId></Error>"
Duration: 106.939146ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
108.87362ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:49:47 GMT
Accept-Ranges=bytes
Vary=Origin
X-Amz-Request-Id=18AA03427ABA44EB
X-Request-Id=NNTjE9kb9Xm
Content-Length=274
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/7ab017fec1ffb420
FAIL (2026-04-26 20:49:47 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03427ABA44EB</RequestId><HostId></HostId></Error>"
Duration: 108.888548ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [.........................XX..................X..XX..X.......]
duration:
964.050896ms
trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:49:36 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060     , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957     , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486    , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 964.06893ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
112.986437ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=18AA033F705C8750
X-Request-Id=gSSyXd1DFaU
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Server=Storj
Vary=Origin
Date=Sun, 26 Apr 2026 20:49:33 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/3c05619947811df
FAIL (2026-04-26 20:49:33 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033F705C8750</RequestId><HostId></HostId></Error>"
Duration: 113.000584ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
117.329806ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=18AA033CE83E9610
X-Request-Id=C3aZ1Yu3ou3
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:49:23 GMT
Content-Length=274
Content-Type=application/xml
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/3afc41aa7316e6f3
FAIL (2026-04-26 20:49:23 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033CE83E9610</RequestId><HostId></HostId></Error>"
Duration: 117.349262ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
106.820504ms
remote:
"tcp:136.0.77.3:443"
response headers:
Server=Storj
X-Amz-Request-Id=18AA033C78F6474D
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:49:21 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Request-Id=3yfAPoA86H9
Content-Length=274
Content-Type=application/xml
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/3964bbf08759ea2
FAIL (2026-04-26 20:49:21 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033C78F6474D</RequestId><HostId></HostId></Error>"
Duration: 106.839881ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
14.403489ms
remote:
"tcp:79.127.223.133:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
Date=Sun, 26 Apr 2026 20:49:20 GMT
Content-Length=284
Content-Type=application/xml
X-Amz-Request-Id=18AA033C61271227
X-Request-Id=vMJWxXCVXW
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/5ea7a7ccc15f6e6c
FAIL (2026-04-26 20:49:20 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033C61271227</RequestId><HostId></HostId></Error>"
Duration: 14.423076ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
106.567242ms
remote:
"tcp:136.0.77.3:443"
response headers:
Server=Storj
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18AA0339D91A1E17
X-Request-Id=gUNUecJhu9V
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:49:09 GMT
Accept-Ranges=bytes
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/5fd690b30dd13b13
FAIL (2026-04-26 20:49:09 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0339D91A1E17</RequestId><HostId></HostId></Error>"
Duration: 106.583523ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [..........................XX..................X..XX..X......]
duration:
1.111604035s
trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:49:07 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060     , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957     , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486    , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1.111624393s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [...........................XX..................X..XX..X.....]
duration:
688.56836ms
trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:48:48 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060     , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957     , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486    , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 688.593508ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
109.92051ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18AA0333DF969ABF
Accept-Ranges=bytes
Content-Length=274
Server=Storj
X-Request-Id=2SgiDEEPr4q
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:48:44 GMT
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/7be901d8ba1ce1d6
FAIL (2026-04-26 20:48:44 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0333DF969ABF</RequestId><HostId></HostId></Error>"
Duration: 109.938144ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
107.671668ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Request-Id=J3b3T3vcrYp
Content-Length=274
Content-Type=application/xml
Server=Storj
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:48:42 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=18AA033369DEE89E
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/3925df9d9040aae0
FAIL (2026-04-26 20:48:42 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033369DEE89E</RequestId><HostId></HostId></Error>"
Duration: 107.691625ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
109.995994ms
remote:
"tcp:136.0.77.3:443"
response headers:
Date=Sun, 26 Apr 2026 20:48:37 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
X-Xss-Protection=1; mode=block
Content-Length=274
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18AA033262CB41EA
X-Request-Id=EhgqzX3vkVu
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/6f4897b902144a74
FAIL (2026-04-26 20:48:37 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA033262CB41EA</RequestId><HostId></HostId></Error>"
Duration: 110.010942ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
13.384399ms
remote:
"tcp:79.127.223.133:443"
response headers:
Accept-Ranges=bytes
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=jFeiBQcJQvr
Date=Sun, 26 Apr 2026 20:48:08 GMT
X-Amz-Request-Id=18AA032B7AF69B85
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/29fd9956b35206f2
FAIL (2026-04-26 20:48:08 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA032B7AF69B85</RequestId><HostId></HostId></Error>"
Duration: 13.404928ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
110.448815ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Vary=Origin
X-Amz-Request-Id=18AA03263C769285
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:47:45 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Request-Id=DHcrm2v2y64
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/1d960c5e667cd29b
FAIL (2026-04-26 20:47:45 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03263C769285</RequestId><HostId></HostId></Error>"
Duration: 110.471587ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
6 out of 60 is failed (threshold=3) [............................XX..................X..XX..X....]
duration:
1.216905929s
trace:
https://jaeger.dev.storj.io/trace/7e17a46f3e735f31
FAIL (2026-04-26 20:47:39 UTC)
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
os={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736436806 (1632h35m37.87542099s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736675173 (1632h35m37.875659367s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.736931343 (1632h35m37.875915537s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737692559 (1632h35m37.876676743s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.737993483 (1632h35m37.876977677s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738250585 (1632h35m37.877234769s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738501204 (1632h35m37.877485398s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.738751202 (1632h35m37.877735396s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739062316 (1632h35m37.87804651s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739362508 (1632h35m37.878346692s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739653704 (1632h35m37.878637887s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.739990565 (1632h35m37.878974759s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.740999265 (1632h35m37.879983449s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.741030444 (1632h35m37.880014627s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.742032170 (1632h35m37.881016365s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Uploading piece...
Apr 26 20:44:18.801438758 (1632h35m37.940422941s) [upload=1435924]: Next returned nil segment
Apr 26 20:44:18.801445039 (1632h35m37.940429223s) [upload=1435924]: Waiting for error group managing segments...
Apr 26 20:44:18.811029118 (1632h35m37.950013303s) [noise=true , address=77.90.31.17:4778     , piece_id=P3IPAR7RNM6T6EWY5XOGRFKCDUMML4OBAY54OVOQW6FCKEIQNK5A, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.819015654 (1632h35m37.957999838s) [noise=true , address=77.90.31.11:4579     , piece_id=GFEM3ZXARXGMDBIAZO2XA3TVGLZKTYWVPU7QPWRYZF3LCC7FBSTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.822213006 (1632h35m37.96119719s) [noise=true , address=45.91.116.8:4060     , piece_id=6GPZRMZSRSTXUL2WUNFWBA5YHXQHC5ZVWTDYVMMIDFT6PQ642OHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.824805934 (1632h35m37.963790118s) [noise=true , address=45.91.116.6:4985     , piece_id=IVJ6QZCXTXAJQGMGW5FS67SL3CPOSCQ5HBIZZU2UGTOK7WA3ZCTQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.840817728 (1632h35m37.979801912s) [noise=true , address=79.127.219.46:4909   , piece_id=22QZTRNNHKFOXLTHFUNV7F3DW6XKAR4REXOZVXOZUBRLWISLCJKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.855154332 (1632h35m37.994138526s) [noise=true , address=45.91.116.7:4022     , piece_id=LQRELGYT3GRSYQLKDZGFAE3CAAH2EOSNMJTD323AGMTLTAOE6EHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:18.877235378 (1632h35m38.016219562s) [noise=true , address=145.79.227.47:4293   , piece_id=CSGR4SMDJKRRYUSPCLXQTKSBASOYE2N55YDEW24GVKI2ZII6XKBA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.057165316 (1632h35m38.19614951s) [noise=true , address=5.231.73.4:4019      , piece_id=6DFUZ5ZJL6XAKDRS222PB4GOUOFTVLXBILRGV77DCSCHCTYWU4NA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:44:19.241969586 (1632h35m38.380953771s) [noise=true , address=79.127.205.234:4210  , piece_id=P2PU4NEEX2OGVQESIJ6MQOIR7XY65MF4SCX4LNJUP52HHZ6NHCRA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: <nil>
Apr 26 20:45:18.701469620 (1632h36m37.840453814s) [noise=true , address=64.49.13.27:4957     , piece_id=WLPMNVNSNAKB4AREIVNSJ52QXXVTECZWSJLZCM2HOY2CFVNBWJDQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12bYqoLXPqxPwKHkGRWx6RSpY8KSnS7QeKafAmtEpGJ5ThmJcDD, address:64.49.13.27:4957): protocol: rpc: dial tcp 64.49.13.27:4957: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701482404 (1632h36m37.840466598s) [noise=true , address=167.17.72.68:4668    , piece_id=XPAIVKOJBOMOBMU47E3BCNPXFPNQTMWJN4WL32DCIF4KYB3OTQPQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:1zTASQ1v892QskBkfQMTqwyaaDfLx5Gy5RtbV9xX4Xnm5Siyuw, address:167.17.72.68:4668): protocol: rpc: dial tcp 167.17.72.68:4668: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701639226 (1632h36m37.840623411s) [noise=true , address=64.49.13.138:4486    , piece_id=4JIWOI37ZUX4P3M53DCKODW3K5VCWKATWDZDDXXTQ45JKHA7NBWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g, address:64.49.13.138:4486): protocol: rpc: dial tcp 64.49.13.138:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701737170 (1632h36m37.840721364s) [noise=true , address=193.149.164.143:4694 , piece_id=EVYUUAPAOIUFPUI6JCXZZJRY2UTY5FA3WOSV3T42XYXFHCEIJQSQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12ATtVD3XyFxzEqwQpSF4t1MWygqEa4Y1CkNj1s43eud8UtuSmx, address:193.149.164.143:4694): protocol: read tcp 5.161.89.252:11832->193.149.164.143:4694: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701742671 (1632h36m37.840726865s) [noise=true , address=167.17.72.71:4781    , piece_id=GRTMS4IOS5IZ7TCIJPZRWJTTFPOWGSNKJIOEQYX2KQNT3OJ2ODKQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:122DUAu2vUiUawKG4APwaTUoLrJVgk4tYQDaZchtKfm46sU27hg, address:167.17.72.71:4781): protocol: write tcp 5.161.89.252:34068->167.17.72.71:4781: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701827419 (1632h36m37.840811604s) [noise=true , address=193.149.164.66:4968  , piece_id=XATZGIDOAVLM3Y3YZTIW7CCPSIRBYQTIQ6YXFCLXDNZDETJKPNWA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12VcpnNCcHGB6KRJGLrRCD81Vg9pqp6KpEeJvKwHed5KsWWP5c2, address:193.149.164.66:4968): protocol: read tcp 5.161.89.252:19740->193.149.164.66:4968: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.701871422 (1632h36m37.840855606s) [noise=true , address=64.49.13.137:4502    , piece_id=3CWDXUUAVHFV5U2OBNPSWU5MXNVWZUKGTTPZRW3YU7BYYAJDFUHA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12YXATeBYy7Q21fYraVJB5aw9zwEXh86FfdHGHFXANEHGGCPyh6, address:64.49.13.137:4502): protocol: rpc: dial tcp 64.49.13.137:4502: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702021373 (1632h36m37.841005557s) [noise=true , address=64.49.13.139:4475    , piece_id=OWLDQXYLAPYCQQZSZEA5PYQONKW57O6Y56PALAH22A3LAARO3LVA, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12cXhkbaJkeWgG1H5AuS3LFVSYcK6ToGHYzV9hHM49wvePJ3LZW, address:64.49.13.139:4475): protocol: read tcp 5.161.89.252:31420->64.49.13.139:4475: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702106553 (1632h36m37.841090737s) [noise=true , address=193.149.164.68:4046  , piece_id=7KNS73R4MX7YG45VEY6TRS4WKCHBQMMOHZOQVBJODC3KOOEVA5BQ, seg_pos={0 0}, upload=1435924]: Done uploading piece. err: ecclient: upload failed (node:12Acjqw5ngFWnBMZdAdVJ5XyCYwHkptho7NzkLhahCY232iA96D, address:193.149.164.68:4046): protocol: read tcp 5.161.89.252:41004->193.149.164.68:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 26 20:45:18.702126190 (1632h36m37.841110384s) [seg_pos={0 0}, upload=1435924]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Apr 26 20:45:18.717830827 (1632h36m37.856815021s) [upload=1435924]: Done uploading segments...
Apr 26 20:45:18.717866273 (1632h36m37.856850467s) [upload=1435924]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1.216925475s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
108.22253ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Request-Id=5711H5wyXYf
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Vary=Origin
X-Amz-Request-Id=18AA0324888CD198
Date=Sun, 26 Apr 2026 20:47:38 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/29f977c11971d5bc
FAIL (2026-04-26 20:47:38 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA0324888CD198</RequestId><HostId></HostId></Error>"
Duration: 108.238009ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
173.449174ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
X-Amz-Request-Id=18AA03233380CC07
Date=Sun, 26 Apr 2026 20:47:32 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Request-Id=Ztn1FG7eu76
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/494d82536073bbf1
FAIL (2026-04-26 20:47:32 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA03233380CC07</RequestId><HostId></HostId></Error>"
Duration: 173.466327ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
16.910437ms
remote:
"tcp:79.127.223.133:443"
response headers:
Content-Type=application/xml
Vary=Origin
Content-Length=284
Server=Storj
X-Amz-Request-Id=18AA031FC0A2B6C1
X-Request-Id=ZnK19Gexz5Q
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:47:17 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/b07a46d30006846
FAIL (2026-04-26 20:47:17 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA031FC0A2B6C1</RequestId><HostId></HostId></Error>"
Duration: 16.928713ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
105.429195ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18AA031ED04D7A5D
X-Request-Id=HzeHqNaZGQQ
X-Xss-Protection=1; mode=block
Date=Sun, 26 Apr 2026 20:47:13 GMT
Content-Length=274
Server=Storj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/36ab75bc1740d310
FAIL (2026-04-26 20:47:13 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18AA031ED04D7A5D</RequestId><HostId></HostId></Error>"
Duration: 105.447349ms edge gateway vhost bgp eu1