Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
339.588858ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:48:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 339.615939ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.89643ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=GFZHDDmAJR5 X-Xss-Protection=1; mode=block Content-Length=274 X-Amz-Request-Id=18ABACD9865930A8 Date=Sat, 02 May 2026 06:48:48 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3262979882f8af56
FAIL (2026-05-02 06:48:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACD9865930A8</RequestId><HostId></HostId></Error>"
Duration: 24.920416ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.28437ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18ABACD56E751EB7 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:48:30 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=jhrp2XSgkpH Content-Length=274 Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/409632a7b1f3a4b9
FAIL (2026-05-02 06:48:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACD56E751EB7</RequestId><HostId></HostId></Error>"
Duration: 23.301152ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.723715ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=18ABACD40488611D X-Request-Id=HB15AmXt3xc X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:48:24 GMT Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2be90871b4974df1
FAIL (2026-05-02 06:48:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACD40488611D</RequestId><HostId></HostId></Error>"
Duration: 31.739675ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
6.53229ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=18ABACD2A2650E7C X-Request-Id=WUam7RBQjj X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:48:18 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7cdf157873c91cc1
FAIL (2026-05-02 06:48:18 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACD2A2650E7C</RequestId><HostId></HostId></Error>"
Duration: 6.541076ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
364.236502ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:48:11 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 364.256028ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.427996ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABACD04EB19B8A X-Request-Id=XQdTqThjXAe X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:48:08 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/160984036a8e56d4
FAIL (2026-05-02 06:48:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACD04EB19B8A</RequestId><HostId></HostId></Error>"
Duration: 22.437864ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.960851ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABACCFE9E7CC0C Date=Sat, 02 May 2026 06:48:06 GMT Accept-Ranges=bytes X-Request-Id=iy9kof88CFh X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6a650270e9a88e82
FAIL (2026-05-02 06:48:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACCFE9E7CC0C</RequestId><HostId></HostId></Error>"
Duration: 21.979397ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
416.462307ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:47:44 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 416.486281ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.167114ms remote:
"tcp:79.127.223.133:443" response headers:
X-Amz-Request-Id=18ABACC9E33996D7 X-Request-Id=2qfJoCXV6xZ X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:47:41 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Accept-Ranges=bytes Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5dc1d742cb0a80fc
FAIL (2026-05-02 06:47:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACC9E33996D7</RequestId><HostId></HostId></Error>"
Duration: 29.185017ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.311825ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sat, 02 May 2026 06:47:39 GMT Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABACC9772C4FDD X-Request-Id=j1HsQ2TihqA target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/13e48f5e3cde2090
FAIL (2026-05-02 06:47:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACC9772C4FDD</RequestId><HostId></HostId></Error>"
Duration: 29.327675ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.014303ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18ABACC2DA82A82E X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:47:10 GMT Accept-Ranges=bytes Content-Type=application/xml X-Request-Id=5M4tTbL2UKY Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/68a455d4e678e997
FAIL (2026-05-02 06:47:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACC2DA82A82E</RequestId><HostId></HostId></Error>"
Duration: 7.029781ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.290067ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 X-Request-Id=bmuh66giFhY X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:47:09 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABACC27B059FBF target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/43b5b1e29f62b961
FAIL (2026-05-02 06:47:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACC27B059FBF</RequestId><HostId></HostId></Error>"
Duration: 22.308322ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.393933ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Date=Sat, 02 May 2026 06:47:02 GMT Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18ABACC107965CD7 X-Request-Id=Fq6LiqTqVLT X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/268119d8b8e61d29
FAIL (2026-05-02 06:47:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACC107965CD7</RequestId><HostId></HostId></Error>"
Duration: 25.522966ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
311.590243ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:46:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 311.606774ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.402626ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18ABACBED9F157E0 X-Request-Id=VoVjqcj4j7m Date=Sat, 02 May 2026 06:46:53 GMT Content-Type=application/xml X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2e502aee5f80eac5
FAIL (2026-05-02 06:46:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACBED9F157E0</RequestId><HostId></HostId></Error>"
Duration: 24.423115ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.744644ms remote:
"tcp:79.127.223.133:443" response headers:
Date=Sat, 02 May 2026 06:46:40 GMT Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18ABACBBCCF57BF3 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Request-Id=8eFN6etnzBG target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7cab676b80bb8c06
FAIL (2026-05-02 06:46:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACBBCCF57BF3</RequestId><HostId></HostId></Error>"
Duration: 10.761747ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.770086ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=qgjsXEewbK X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:46:37 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=18ABACBB002199D9 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/41e0b05cefd73860
FAIL (2026-05-02 06:46:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACBB002199D9</RequestId><HostId></HostId></Error>"
Duration: 29.790243ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
433.91067ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:46:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 433.929595ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.134552ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABACBA87B5D519 X-Request-Id=P3FwgDVGRa X-Xss-Protection=1; mode=block Content-Length=274 Date=Sat, 02 May 2026 06:46:35 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/379e1809d0b23a4d
FAIL (2026-05-02 06:46:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACBA87B5D519</RequestId><HostId></HostId></Error>"
Duration: 26.150662ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.880681ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18ABACB76D543823 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=TeCSpibNjuG X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:46:21 GMT Content-Length=274 Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/69f5b62e24d22498
FAIL (2026-05-02 06:46:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACB76D543823</RequestId><HostId></HostId></Error>"
Duration: 21.896601ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.819015ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18ABACB752E80F3B X-Request-Id=f8zR9qsfqP2 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:46:21 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/4507123bddbbf462
FAIL (2026-05-02 06:46:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACB752E80F3B</RequestId><HostId></HostId></Error>"
Duration: 21.835296ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.221643ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18ABACB37A4AF971 X-Request-Id=EiTWFNB6id3 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Date=Sat, 02 May 2026 06:46:04 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/26a2e10811282dfa
FAIL (2026-05-02 06:46:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACB37A4AF971</RequestId><HostId></HostId></Error>"
Duration: 23.236482ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.217651ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=gbJjiyomqvG Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18ABACB0CFB4EDF8 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:45:53 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2c8cbd43f5bbcfb6
FAIL (2026-05-02 06:45:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACB0CFB4EDF8</RequestId><HostId></HostId></Error>"
Duration: 22.228162ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.106736ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:45:46 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18ABACAF41373B30 X-Request-Id=E7oRd24qPwU Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1caf8b90d68287a2
FAIL (2026-05-02 06:45:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACAF41373B30</RequestId><HostId></HostId></Error>"
Duration: 28.127524ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
293.697675ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:45:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 293.792743ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
18.212688ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18ABACAC4D0EE241 X-Request-Id=ctFCFm8D6W X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin Date=Sat, 02 May 2026 06:45:33 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4a4ad5d85f35e1c6
FAIL (2026-05-02 06:45:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACAC4D0EE241</RequestId><HostId></HostId></Error>"
Duration: 18.231502ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.015928ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:45:15 GMT Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=18ABACA80D9A2A7B X-Request-Id=aixATH3nz5G Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/585516d09bd3c175
FAIL (2026-05-02 06:45:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACA80D9A2A7B</RequestId><HostId></HostId></Error>"
Duration: 23.035935ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.881451ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:45:09 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18ABACA67E541DB1 X-Request-Id=HMnTnuZzrji target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1f6ee45833513c26
FAIL (2026-05-02 06:45:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACA67E541DB1</RequestId><HostId></HostId></Error>"
Duration: 21.898062ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.254853ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Date=Sat, 02 May 2026 06:45:05 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18ABACA5C92FF23C X-Request-Id=67poaBDFCjK X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/9b96a44754ab847
FAIL (2026-05-02 06:45:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACA5C92FF23C</RequestId><HostId></HostId></Error>"
Duration: 22.27015ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.274456ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Date=Sat, 02 May 2026 06:44:43 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18ABACA0AA6BDC79 X-Request-Id=TUE5Bt3YjdJ X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2c85da9ff546285c
FAIL (2026-05-02 06:44:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACA0AA6BDC79</RequestId><HostId></HostId></Error>"
Duration: 24.289754ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
40.772881ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18ABAC9F9EC69EC2 X-Request-Id=4sTeX2zidie X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin Date=Sat, 02 May 2026 06:44:39 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/eb15c571280219c
FAIL (2026-05-02 06:44:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC9F9EC69EC2</RequestId><HostId></HostId></Error>"
Duration: 40.808279ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
409.923844ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:44:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 409.945204ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.164505ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Content-Length=284 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18ABAC9B0D11A63B X-Request-Id=JM23WJ7Bynr Date=Sat, 02 May 2026 06:44:19 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/964a54bc3a07444
FAIL (2026-05-02 06:44:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC9B0D11A63B</RequestId><HostId></HostId></Error>"
Duration: 31.179573ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.631334ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin Date=Sat, 02 May 2026 06:44:04 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18ABAC978B0DDE73 X-Request-Id=iTCGnXD8QcG X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1004cd7b1dc97539
FAIL (2026-05-02 06:44:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC978B0DDE73</RequestId><HostId></HostId></Error>"
Duration: 21.647393ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.110159ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC9741F110D4 X-Request-Id=UJULH11xhPZ Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:44:03 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/67b16865b07039ae
FAIL (2026-05-02 06:44:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC9741F110D4</RequestId><HostId></HostId></Error>"
Duration: 29.121869ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.202822ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18ABAC945FB880DE X-Request-Id=5RDZ1gfGsUC Date=Sat, 02 May 2026 06:43:51 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/45fd7b3c039aa190
FAIL (2026-05-02 06:43:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC945FB880DE</RequestId><HostId></HostId></Error>"
Duration: 32.214995ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
380.507772ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:43:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 380.552445ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.155921ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=BfJktNJ46wr Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18ABAC8E03F651E2 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:43:23 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/473d47b9fc2d76a0
FAIL (2026-05-02 06:43:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC8E03F651E2</RequestId><HostId></HostId></Error>"
Duration: 23.168996ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.396322ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC8ACD146E2F Date=Sat, 02 May 2026 06:43:10 GMT Content-Security-Policy=block-all-mixed-content X-Request-Id=PvZdwSz3o9Q X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/33fb54e3b6b12337
FAIL (2026-05-02 06:43:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC8ACD146E2F</RequestId><HostId></HostId></Error>"
Duration: 26.41145ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.863708ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC89C853E20C Date=Sat, 02 May 2026 06:43:05 GMT Accept-Ranges=bytes X-Request-Id=8MhpSwP4kKo X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/9c20ab0edab5e43
FAIL (2026-05-02 06:43:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC89C853E20C</RequestId><HostId></HostId></Error>"
Duration: 8.958185ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
391.274658ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:43:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 391.296027ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.13396ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18ABAC885AEC3247 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:42:59 GMT Content-Length=274 Server=Storj Vary=Origin X-Request-Id=ibkn4fxSjjB target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/b923a5d69b15085
FAIL (2026-05-02 06:42:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC885AEC3247</RequestId><HostId></HostId></Error>"
Duration: 26.158035ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.657118ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18ABAC84D2669CF2 X-Request-Id=SiCHt4pvowc Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:42:44 GMT Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3318edcae8293826
FAIL (2026-05-02 06:42:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC84D2669CF2</RequestId><HostId></HostId></Error>"
Duration: 30.669211ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.796227ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18ABAC81B90EE04B X-Request-Id=GVqLSYFe3EA X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Date=Sat, 02 May 2026 06:42:31 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3198b13dea47fb29
FAIL (2026-05-02 06:42:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC81B90EE04B</RequestId><HostId></HostId></Error>"
Duration: 17.814122ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.947718ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=aaEnfXJyq2F X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18ABAC815A1B17C6 Date=Sat, 02 May 2026 06:42:29 GMT Content-Length=274 Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/76cdfa2f5963a783
FAIL (2026-05-02 06:42:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC815A1B17C6</RequestId><HostId></HostId></Error>"
Duration: 24.968738ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.110085ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=MJ4e3ekMAwg X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:42:13 GMT Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18ABAC7D85A62CB9 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/34596a8c7a616abf
FAIL (2026-05-02 06:42:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC7D85A62CB9</RequestId><HostId></HostId></Error>"
Duration: 23.121116ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
317.12721ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:41:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 317.145853ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.57783ms remote:
"tcp:79.127.223.133:443" response headers:
X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content X-Request-Id=VFprF6kaUM Date=Sat, 02 May 2026 06:41:48 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC77CA7288B1 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3963a0bdf702978f
FAIL (2026-05-02 06:41:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC77CA7288B1</RequestId><HostId></HostId></Error>"
Duration: 7.594542ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.426302ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=A5GD4gcjQ67 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:41:47 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=18ABAC7786122013 Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1474fccbafec6759
FAIL (2026-05-02 06:41:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC7786122013</RequestId><HostId></HostId></Error>"
Duration: 22.441671ms
edge
gateway
vhost
bgp
eu1
|