Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 726034 reports (Page 605 of 14521)
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
22.254853ms
remote:
"tcp:136.0.77.3:443"
response headers:
Server=Storj
Date=Sat, 02 May 2026 06:45:05 GMT
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=18ABACA5C92FF23C
X-Request-Id=67poaBDFCjK
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/9b96a44754ab847
FAIL (2026-05-02 06:45:05 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACA5C92FF23C</RequestId><HostId></HostId></Error>"
Duration: 22.27015ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
24.274456ms
remote:
"tcp:136.0.77.3:443"
response headers:
Server=Storj
Date=Sat, 02 May 2026 06:44:43 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18ABACA0AA6BDC79
X-Request-Id=TUE5Bt3YjdJ
X-Xss-Protection=1; mode=block
Content-Length=274
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/2c85da9ff546285c
FAIL (2026-05-02 06:44:43 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACA0AA6BDC79</RequestId><HostId></HostId></Error>"
Duration: 24.289754ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
40.772881ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=18ABAC9F9EC69EC2
X-Request-Id=4sTeX2zidie
X-Xss-Protection=1; mode=block
Content-Length=274
Content-Type=application/xml
Server=Storj
Vary=Origin
Date=Sat, 02 May 2026 06:44:39 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/eb15c571280219c
FAIL (2026-05-02 06:44:39 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC9F9EC69EC2</RequestId><HostId></HostId></Error>"
Duration: 40.808279ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
409.923844ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:44:23 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 409.945204ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
31.164505ms
remote:
"tcp:79.127.223.133:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Xss-Protection=1; mode=block
Content-Length=284
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18ABAC9B0D11A63B
X-Request-Id=JM23WJ7Bynr
Date=Sat, 02 May 2026 06:44:19 GMT
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/964a54bc3a07444
FAIL (2026-05-02 06:44:19 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC9B0D11A63B</RequestId><HostId></HostId></Error>"
Duration: 31.179573ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
21.631334ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Server=Storj
Vary=Origin
Date=Sat, 02 May 2026 06:44:04 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=18ABAC978B0DDE73
X-Request-Id=iTCGnXD8QcG
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/1004cd7b1dc97539
FAIL (2026-05-02 06:44:04 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC978B0DDE73</RequestId><HostId></HostId></Error>"
Duration: 21.647393ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
29.110159ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18ABAC9741F110D4
X-Request-Id=UJULH11xhPZ
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:44:03 GMT
Accept-Ranges=bytes
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/67b16865b07039ae
FAIL (2026-05-02 06:44:03 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC9741F110D4</RequestId><HostId></HostId></Error>"
Duration: 29.121869ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
32.202822ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
X-Xss-Protection=1; mode=block
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=18ABAC945FB880DE
X-Request-Id=5RDZ1gfGsUC
Date=Sat, 02 May 2026 06:43:51 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/45fd7b3c039aa190
FAIL (2026-05-02 06:43:51 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC945FB880DE</RequestId><HostId></HostId></Error>"
Duration: 32.214995ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
380.507772ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:43:49 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 380.552445ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
23.155921ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=BfJktNJ46wr
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=18ABAC8E03F651E2
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:43:23 GMT
Accept-Ranges=bytes
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/473d47b9fc2d76a0
FAIL (2026-05-02 06:43:23 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC8E03F651E2</RequestId><HostId></HostId></Error>"
Duration: 23.168996ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
26.396322ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18ABAC8ACD146E2F
Date=Sat, 02 May 2026 06:43:10 GMT
Content-Security-Policy=block-all-mixed-content
X-Request-Id=PvZdwSz3o9Q
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/33fb54e3b6b12337
FAIL (2026-05-02 06:43:10 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC8ACD146E2F</RequestId><HostId></HostId></Error>"
Duration: 26.41145ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
8.863708ms
remote:
"tcp:79.127.223.133:443"
response headers:
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18ABAC89C853E20C
Date=Sat, 02 May 2026 06:43:05 GMT
Accept-Ranges=bytes
X-Request-Id=8MhpSwP4kKo
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/9c20ab0edab5e43
FAIL (2026-05-02 06:43:05 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC89C853E20C</RequestId><HostId></HostId></Error>"
Duration: 8.958185ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
391.274658ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:43:04 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 391.296027ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
26.13396ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=18ABAC885AEC3247
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:42:59 GMT
Content-Length=274
Server=Storj
Vary=Origin
X-Request-Id=ibkn4fxSjjB
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/b923a5d69b15085
FAIL (2026-05-02 06:42:59 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC885AEC3247</RequestId><HostId></HostId></Error>"
Duration: 26.158035ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
30.657118ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Amz-Request-Id=18ABAC84D2669CF2
X-Request-Id=SiCHt4pvowc
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:42:44 GMT
Content-Type=application/xml
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/3318edcae8293826
FAIL (2026-05-02 06:42:44 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC84D2669CF2</RequestId><HostId></HostId></Error>"
Duration: 30.669211ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
17.796227ms
remote:
"tcp:79.127.223.133:443"
response headers:
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=18ABAC81B90EE04B
X-Request-Id=GVqLSYFe3EA
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
Date=Sat, 02 May 2026 06:42:31 GMT
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/3198b13dea47fb29
FAIL (2026-05-02 06:42:31 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC81B90EE04B</RequestId><HostId></HostId></Error>"
Duration: 17.814122ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
24.947718ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Request-Id=aaEnfXJyq2F
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
X-Amz-Request-Id=18ABAC815A1B17C6
Date=Sat, 02 May 2026 06:42:29 GMT
Content-Length=274
Server=Storj
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/76cdfa2f5963a783
FAIL (2026-05-02 06:42:29 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC815A1B17C6</RequestId><HostId></HostId></Error>"
Duration: 24.968738ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
23.110085ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=MJ4e3ekMAwg
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:42:13 GMT
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=18ABAC7D85A62CB9
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/34596a8c7a616abf
FAIL (2026-05-02 06:42:13 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC7D85A62CB9</RequestId><HostId></HostId></Error>"
Duration: 23.121116ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
317.12721ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:41:58 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 317.145853ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
7.57783ms
remote:
"tcp:79.127.223.133:443"
response headers:
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
X-Request-Id=VFprF6kaUM
Date=Sat, 02 May 2026 06:41:48 GMT
Accept-Ranges=bytes
Content-Length=284
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18ABAC77CA7288B1
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/3963a0bdf702978f
FAIL (2026-05-02 06:41:48 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC77CA7288B1</RequestId><HostId></HostId></Error>"
Duration: 7.594542ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
22.426302ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Request-Id=A5GD4gcjQ67
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:41:47 GMT
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18ABAC7786122013
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/1474fccbafec6759
FAIL (2026-05-02 06:41:47 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC7786122013</RequestId><HostId></HostId></Error>"
Duration: 22.441671ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
27.180061ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=18ABAC772C211686
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:41:45 GMT
Content-Type=application/xml
X-Request-Id=QmoKHjto7v3
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/4e91ebf42228f9b
FAIL (2026-05-02 06:41:45 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC772C211686</RequestId><HostId></HostId></Error>"
Duration: 27.224475ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
22.60053ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=18ABAC75475B15C5
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:41:37 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Vary=Origin
X-Request-Id=MGdcbSiWAuw
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/3b1f7b80c6acadbb
FAIL (2026-05-02 06:41:37 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC75475B15C5</RequestId><HostId></HostId></Error>"
Duration: 22.615217ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
7.282857ms
remote:
"tcp:79.127.223.133:443"
response headers:
Vary=Origin
X-Amz-Request-Id=18ABAC735DFFB890
Date=Sat, 02 May 2026 06:41:29 GMT
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Request-Id=hwVGPCi2p51
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/7aa88516be15cba
FAIL (2026-05-02 06:41:29 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC735DFFB890</RequestId><HostId></HostId></Error>"
Duration: 7.312383ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
25.134087ms
remote:
"tcp:79.127.223.133:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=2f4apG2Biby
Content-Length=284
X-Amz-Request-Id=18ABAC6F73F5A353
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:41:12 GMT
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/235cd303878ca35a
FAIL (2026-05-02 06:41:12 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC6F73F5A353</RequestId><HostId></HostId></Error>"
Duration: 25.154957ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
23.657389ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Request-Id=K1hHCUzhP7C
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=18ABAC6F79C4CF8D
Date=Sat, 02 May 2026 06:41:12 GMT
Content-Type=application/xml
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/484b76f5cea2d390
FAIL (2026-05-02 06:41:12 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC6F79C4CF8D</RequestId><HostId></HostId></Error>"
Duration: 23.759672ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
28.612034ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
X-Amz-Request-Id=18ABAC6AE6993CD8
X-Request-Id=Y9RQniQSGm6
Date=Sat, 02 May 2026 06:40:53 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/51e95730bdf8d85c
FAIL (2026-05-02 06:40:53 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC6AE6993CD8</RequestId><HostId></HostId></Error>"
Duration: 28.631811ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
23.91905ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=Ug6Sz6qSmew
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=18ABAC6AB9455972
Date=Sat, 02 May 2026 06:40:52 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/1a8361455357900b
FAIL (2026-05-02 06:40:52 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC6AB9455972</RequestId><HostId></HostId></Error>"
Duration: 23.940069ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
329.063075ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:40:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 329.08152ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
25.093551ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18ABAC646A9F424A
X-Request-Id=b7uxE2C2mUy
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:40:25 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/2ec821dc8c532443
FAIL (2026-05-02 06:40:25 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC646A9F424A</RequestId><HostId></HostId></Error>"
Duration: 25.110452ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
13.25676ms
remote:
"tcp:79.127.223.133:443"
response headers:
Content-Type=application/xml
X-Amz-Request-Id=18ABAC63CA8388DA
Date=Sat, 02 May 2026 06:40:22 GMT
Accept-Ranges=bytes
Content-Length=284
Server=Storj
Vary=Origin
X-Request-Id=AbEz5D52oAV
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/da23671ee59eb7
FAIL (2026-05-02 06:40:22 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC63CA8388DA</RequestId><HostId></HostId></Error>"
Duration: 13.274683ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
25.289507ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18ABAC609596ECE8
X-Request-Id=fHA3dcwFxLt
Date=Sat, 02 May 2026 06:40:08 GMT
Content-Length=274
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/2041225bdef8a5ef
FAIL (2026-05-02 06:40:08 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC609596ECE8</RequestId><HostId></HostId></Error>"
Duration: 25.302642ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
454.122363ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:39:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 454.148633ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
22.32811ms
remote:
"tcp:136.0.77.3:443"
response headers:
Vary=Origin
X-Amz-Request-Id=18ABAC5D1F65F582
Date=Sat, 02 May 2026 06:39:53 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Request-Id=HTq3HkwLKF
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/6b8790d55814f11f
FAIL (2026-05-02 06:39:53 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC5D1F65F582</RequestId><HostId></HostId></Error>"
Duration: 22.346494ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
22.039969ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18ABAC5CD1B13D85
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Request-Id=hacjHcf7B1Q
Date=Sat, 02 May 2026 06:39:52 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/f32f6f7a65d7898
FAIL (2026-05-02 06:39:52 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC5CD1B13D85</RequestId><HostId></HostId></Error>"
Duration: 22.05641ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
24.574179ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Length=274
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=T2nX26PfE9X
Date=Sat, 02 May 2026 06:39:48 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=18ABAC5BF51F1720
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/20670b20d11ae7f6
FAIL (2026-05-02 06:39:48 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC5BF51F1720</RequestId><HostId></HostId></Error>"
Duration: 24.594869ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
408.600885ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:39:37 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 408.611776ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
21.687729ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=LCPYFzK5HG6
X-Xss-Protection=1; mode=block
X-Amz-Request-Id=18ABAC57E4807E90
Date=Sat, 02 May 2026 06:39:31 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/322811267f10a0d9
FAIL (2026-05-02 06:39:31 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC57E4807E90</RequestId><HostId></HostId></Error>"
Duration: 21.701174ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
10.558154ms
remote:
"tcp:79.127.223.133:443"
response headers:
Vary=Origin
X-Amz-Request-Id=18ABAC560B5F4027
Date=Sat, 02 May 2026 06:39:23 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
X-Request-Id=U97rKT35Eh6
X-Xss-Protection=1; mode=block
Content-Length=284
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/7d6fe0272b77a71b
FAIL (2026-05-02 06:39:23 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC560B5F4027</RequestId><HostId></HostId></Error>"
Duration: 10.574093ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
22.829659ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Vary=Origin
X-Request-Id=A9kDqAbAiRQ
Date=Sat, 02 May 2026 06:39:14 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=18ABAC53F66B2708
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/7e4cc5232cd4a5e3
FAIL (2026-05-02 06:39:14 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC53F66B2708</RequestId><HostId></HostId></Error>"
Duration: 22.845368ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
26.620812ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=18ABAC52CF2C50B3
X-Request-Id=a7a8s3PqARZ
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Date=Sat, 02 May 2026 06:39:09 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/6d2222c4904d2b8
FAIL (2026-05-02 06:39:09 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC52CF2C50B3</RequestId><HostId></HostId></Error>"
Duration: 26.634998ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
324.916843ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:38:57 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 324.933637ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
459.304184ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:38:42 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 459.320484ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
22.075886ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=18ABAC4B57AACF21
X-Request-Id=4y9xkodorKF
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:38:37 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/75988be6511c7712
FAIL (2026-05-02 06:38:37 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC4B57AACF21</RequestId><HostId></HostId></Error>"
Duration: 22.095513ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.072919ms
remote:
"tcp:79.127.223.133:443"
response headers:
X-Request-Id=Wegg9Qgxnww
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
Date=Sat, 02 May 2026 06:38:36 GMT
Accept-Ranges=bytes
Content-Length=284
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18ABAC4B0BD76D5D
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/50a9e7f40a0646dc
FAIL (2026-05-02 06:38:36 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC4B0BD76D5D</RequestId><HostId></HostId></Error>"
Duration: 11.088387ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
22.552781ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18ABAC4A2424E331
X-Request-Id=3YS8tDXFSLL
Date=Sat, 02 May 2026 06:38:32 GMT
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/372c14f794e183d8
FAIL (2026-05-02 06:38:32 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC4A2424E331</RequestId><HostId></HostId></Error>"
Duration: 22.564312ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
38.325235ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=18ABAC458AE7BC53
X-Request-Id=Sg7y6Hk1HCr
Date=Sat, 02 May 2026 06:38:12 GMT
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/309d80a3807ee8d4
FAIL (2026-05-02 06:38:12 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC458AE7BC53</RequestId><HostId></HostId></Error>"
Duration: 38.343969ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
6.799971ms
remote:
"tcp:79.127.223.133:443"
response headers:
X-Amz-Request-Id=18ABAC43F0BD6E37
Accept-Ranges=bytes
Content-Length=284
Content-Type=application/xml
Server=Storj
X-Request-Id=UNMnsBLDGX1
X-Xss-Protection=1; mode=block
Date=Sat, 02 May 2026 06:38:05 GMT
Content-Security-Policy=block-all-mixed-content
Vary=Origin
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/5dbf7db498b07800
FAIL (2026-05-02 06:38:05 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC43F0BD6E37</RequestId><HostId></HostId></Error>"
Duration: 6.812084ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
340.458218ms
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:37:55 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 340.472936ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.018340991s
trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:37:54 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May  2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May  2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May  2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May  2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May  2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May  2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May  2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May  2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May  2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May  2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May  2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May  2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233   , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548   , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584   , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603   , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155    , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016   , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296    , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052   , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089   , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123   , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977   , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019     , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May  2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085    , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May  2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153    , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May  2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046     , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May  2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260    , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May  2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May  2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May  2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 30.018354787s core uplink us-select-1