Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.254853ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Date=Sat, 02 May 2026 06:45:05 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18ABACA5C92FF23C X-Request-Id=67poaBDFCjK X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/9b96a44754ab847
FAIL (2026-05-02 06:45:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACA5C92FF23C</RequestId><HostId></HostId></Error>"
Duration: 22.27015ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.274456ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Date=Sat, 02 May 2026 06:44:43 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18ABACA0AA6BDC79 X-Request-Id=TUE5Bt3YjdJ X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2c85da9ff546285c
FAIL (2026-05-02 06:44:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABACA0AA6BDC79</RequestId><HostId></HostId></Error>"
Duration: 24.289754ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
40.772881ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18ABAC9F9EC69EC2 X-Request-Id=4sTeX2zidie X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin Date=Sat, 02 May 2026 06:44:39 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/eb15c571280219c
FAIL (2026-05-02 06:44:39 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC9F9EC69EC2</RequestId><HostId></HostId></Error>"
Duration: 40.808279ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
409.923844ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:44:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 409.945204ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.164505ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Content-Length=284 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18ABAC9B0D11A63B X-Request-Id=JM23WJ7Bynr Date=Sat, 02 May 2026 06:44:19 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/964a54bc3a07444
FAIL (2026-05-02 06:44:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC9B0D11A63B</RequestId><HostId></HostId></Error>"
Duration: 31.179573ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.631334ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin Date=Sat, 02 May 2026 06:44:04 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18ABAC978B0DDE73 X-Request-Id=iTCGnXD8QcG X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1004cd7b1dc97539
FAIL (2026-05-02 06:44:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC978B0DDE73</RequestId><HostId></HostId></Error>"
Duration: 21.647393ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.110159ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC9741F110D4 X-Request-Id=UJULH11xhPZ Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:44:03 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/67b16865b07039ae
FAIL (2026-05-02 06:44:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC9741F110D4</RequestId><HostId></HostId></Error>"
Duration: 29.121869ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.202822ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18ABAC945FB880DE X-Request-Id=5RDZ1gfGsUC Date=Sat, 02 May 2026 06:43:51 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/45fd7b3c039aa190
FAIL (2026-05-02 06:43:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC945FB880DE</RequestId><HostId></HostId></Error>"
Duration: 32.214995ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
380.507772ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:43:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 380.552445ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.155921ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=BfJktNJ46wr Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18ABAC8E03F651E2 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:43:23 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/473d47b9fc2d76a0
FAIL (2026-05-02 06:43:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC8E03F651E2</RequestId><HostId></HostId></Error>"
Duration: 23.168996ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.396322ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC8ACD146E2F Date=Sat, 02 May 2026 06:43:10 GMT Content-Security-Policy=block-all-mixed-content X-Request-Id=PvZdwSz3o9Q X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/33fb54e3b6b12337
FAIL (2026-05-02 06:43:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC8ACD146E2F</RequestId><HostId></HostId></Error>"
Duration: 26.41145ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.863708ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC89C853E20C Date=Sat, 02 May 2026 06:43:05 GMT Accept-Ranges=bytes X-Request-Id=8MhpSwP4kKo X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/9c20ab0edab5e43
FAIL (2026-05-02 06:43:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC89C853E20C</RequestId><HostId></HostId></Error>"
Duration: 8.958185ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
391.274658ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:43:04 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 391.296027ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.13396ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18ABAC885AEC3247 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:42:59 GMT Content-Length=274 Server=Storj Vary=Origin X-Request-Id=ibkn4fxSjjB target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/b923a5d69b15085
FAIL (2026-05-02 06:42:59 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC885AEC3247</RequestId><HostId></HostId></Error>"
Duration: 26.158035ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.657118ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18ABAC84D2669CF2 X-Request-Id=SiCHt4pvowc Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:42:44 GMT Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3318edcae8293826
FAIL (2026-05-02 06:42:44 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC84D2669CF2</RequestId><HostId></HostId></Error>"
Duration: 30.669211ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.796227ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18ABAC81B90EE04B X-Request-Id=GVqLSYFe3EA X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj Date=Sat, 02 May 2026 06:42:31 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3198b13dea47fb29
FAIL (2026-05-02 06:42:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC81B90EE04B</RequestId><HostId></HostId></Error>"
Duration: 17.814122ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.947718ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=aaEnfXJyq2F X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18ABAC815A1B17C6 Date=Sat, 02 May 2026 06:42:29 GMT Content-Length=274 Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/76cdfa2f5963a783
FAIL (2026-05-02 06:42:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC815A1B17C6</RequestId><HostId></HostId></Error>"
Duration: 24.968738ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.110085ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=MJ4e3ekMAwg X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:42:13 GMT Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18ABAC7D85A62CB9 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/34596a8c7a616abf
FAIL (2026-05-02 06:42:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC7D85A62CB9</RequestId><HostId></HostId></Error>"
Duration: 23.121116ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
317.12721ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:41:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 317.145853ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.57783ms remote:
"tcp:79.127.223.133:443" response headers:
X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content X-Request-Id=VFprF6kaUM Date=Sat, 02 May 2026 06:41:48 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC77CA7288B1 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3963a0bdf702978f
FAIL (2026-05-02 06:41:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC77CA7288B1</RequestId><HostId></HostId></Error>"
Duration: 7.594542ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.426302ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=A5GD4gcjQ67 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:41:47 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=18ABAC7786122013 Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1474fccbafec6759
FAIL (2026-05-02 06:41:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC7786122013</RequestId><HostId></HostId></Error>"
Duration: 22.441671ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.180061ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC772C211686 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:41:45 GMT Content-Type=application/xml X-Request-Id=QmoKHjto7v3 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4e91ebf42228f9b
FAIL (2026-05-02 06:41:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC772C211686</RequestId><HostId></HostId></Error>"
Duration: 27.224475ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.60053ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18ABAC75475B15C5 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:41:37 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Request-Id=MGdcbSiWAuw target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/3b1f7b80c6acadbb
FAIL (2026-05-02 06:41:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC75475B15C5</RequestId><HostId></HostId></Error>"
Duration: 22.615217ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.282857ms remote:
"tcp:79.127.223.133:443" response headers:
Vary=Origin X-Amz-Request-Id=18ABAC735DFFB890 Date=Sat, 02 May 2026 06:41:29 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=hwVGPCi2p51 X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7aa88516be15cba
FAIL (2026-05-02 06:41:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC735DFFB890</RequestId><HostId></HostId></Error>"
Duration: 7.312383ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.134087ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=2f4apG2Biby Content-Length=284 X-Amz-Request-Id=18ABAC6F73F5A353 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:41:12 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/235cd303878ca35a
FAIL (2026-05-02 06:41:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC6F73F5A353</RequestId><HostId></HostId></Error>"
Duration: 25.154957ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.657389ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=K1hHCUzhP7C X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC6F79C4CF8D Date=Sat, 02 May 2026 06:41:12 GMT Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/484b76f5cea2d390
FAIL (2026-05-02 06:41:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC6F79C4CF8D</RequestId><HostId></HostId></Error>"
Duration: 23.759672ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.612034ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=18ABAC6AE6993CD8 X-Request-Id=Y9RQniQSGm6 Date=Sat, 02 May 2026 06:40:53 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/51e95730bdf8d85c
FAIL (2026-05-02 06:40:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC6AE6993CD8</RequestId><HostId></HostId></Error>"
Duration: 28.631811ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.91905ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=Ug6Sz6qSmew X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18ABAC6AB9455972 Date=Sat, 02 May 2026 06:40:52 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1a8361455357900b
FAIL (2026-05-02 06:40:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC6AB9455972</RequestId><HostId></HostId></Error>"
Duration: 23.940069ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
329.063075ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:40:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 329.08152ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.093551ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18ABAC646A9F424A X-Request-Id=b7uxE2C2mUy X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:40:25 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2ec821dc8c532443
FAIL (2026-05-02 06:40:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC646A9F424A</RequestId><HostId></HostId></Error>"
Duration: 25.110452ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.25676ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=18ABAC63CA8388DA Date=Sat, 02 May 2026 06:40:22 GMT Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Request-Id=AbEz5D52oAV X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/da23671ee59eb7
FAIL (2026-05-02 06:40:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC63CA8388DA</RequestId><HostId></HostId></Error>"
Duration: 13.274683ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.289507ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC609596ECE8 X-Request-Id=fHA3dcwFxLt Date=Sat, 02 May 2026 06:40:08 GMT Content-Length=274 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2041225bdef8a5ef
FAIL (2026-05-02 06:40:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC609596ECE8</RequestId><HostId></HostId></Error>"
Duration: 25.302642ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
454.122363ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:39:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 454.148633ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.32811ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18ABAC5D1F65F582 Date=Sat, 02 May 2026 06:39:53 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=HTq3HkwLKF X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6b8790d55814f11f
FAIL (2026-05-02 06:39:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC5D1F65F582</RequestId><HostId></HostId></Error>"
Duration: 22.346494ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.039969ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18ABAC5CD1B13D85 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=hacjHcf7B1Q Date=Sat, 02 May 2026 06:39:52 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/f32f6f7a65d7898
FAIL (2026-05-02 06:39:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC5CD1B13D85</RequestId><HostId></HostId></Error>"
Duration: 22.05641ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.574179ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=T2nX26PfE9X Date=Sat, 02 May 2026 06:39:48 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18ABAC5BF51F1720 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/20670b20d11ae7f6
FAIL (2026-05-02 06:39:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC5BF51F1720</RequestId><HostId></HostId></Error>"
Duration: 24.594869ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
408.600885ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:39:37 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 408.611776ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.687729ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=LCPYFzK5HG6 X-Xss-Protection=1; mode=block X-Amz-Request-Id=18ABAC57E4807E90 Date=Sat, 02 May 2026 06:39:31 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/322811267f10a0d9
FAIL (2026-05-02 06:39:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC57E4807E90</RequestId><HostId></HostId></Error>"
Duration: 21.701174ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
10.558154ms remote:
"tcp:79.127.223.133:443" response headers:
Vary=Origin X-Amz-Request-Id=18ABAC560B5F4027 Date=Sat, 02 May 2026 06:39:23 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Request-Id=U97rKT35Eh6 X-Xss-Protection=1; mode=block Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7d6fe0272b77a71b
FAIL (2026-05-02 06:39:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC560B5F4027</RequestId><HostId></HostId></Error>"
Duration: 10.574093ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.829659ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Request-Id=A9kDqAbAiRQ Date=Sat, 02 May 2026 06:39:14 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18ABAC53F66B2708 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7e4cc5232cd4a5e3
FAIL (2026-05-02 06:39:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC53F66B2708</RequestId><HostId></HostId></Error>"
Duration: 22.845368ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.620812ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC52CF2C50B3 X-Request-Id=a7a8s3PqARZ X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Date=Sat, 02 May 2026 06:39:09 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6d2222c4904d2b8
FAIL (2026-05-02 06:39:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC52CF2C50B3</RequestId><HostId></HostId></Error>"
Duration: 26.634998ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
324.916843ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:38:57 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 324.933637ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
459.304184ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:38:42 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 459.320484ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.075886ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18ABAC4B57AACF21 X-Request-Id=4y9xkodorKF Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:38:37 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/75988be6511c7712
FAIL (2026-05-02 06:38:37 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC4B57AACF21</RequestId><HostId></HostId></Error>"
Duration: 22.095513ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.072919ms remote:
"tcp:79.127.223.133:443" response headers:
X-Request-Id=Wegg9Qgxnww X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Date=Sat, 02 May 2026 06:38:36 GMT Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18ABAC4B0BD76D5D target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/50a9e7f40a0646dc
FAIL (2026-05-02 06:38:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC4B0BD76D5D</RequestId><HostId></HostId></Error>"
Duration: 11.088387ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.552781ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18ABAC4A2424E331 X-Request-Id=3YS8tDXFSLL Date=Sat, 02 May 2026 06:38:32 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/372c14f794e183d8
FAIL (2026-05-02 06:38:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC4A2424E331</RequestId><HostId></HostId></Error>"
Duration: 22.564312ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
38.325235ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18ABAC458AE7BC53 X-Request-Id=Sg7y6Hk1HCr Date=Sat, 02 May 2026 06:38:12 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/309d80a3807ee8d4
FAIL (2026-05-02 06:38:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC458AE7BC53</RequestId><HostId></HostId></Error>"
Duration: 38.343969ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
6.799971ms remote:
"tcp:79.127.223.133:443" response headers:
X-Amz-Request-Id=18ABAC43F0BD6E37 Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj X-Request-Id=UNMnsBLDGX1 X-Xss-Protection=1; mode=block Date=Sat, 02 May 2026 06:38:05 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/5dbf7db498b07800
FAIL (2026-05-02 06:38:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18ABAC43F0BD6E37</RequestId><HostId></HostId></Error>"
Duration: 6.812084ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
340.458218ms trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:37:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 340.472936ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.018340991s trace:
https://jaeger.dev.storj.io/trace/640ae0eb412f34f2
FAIL (2026-05-02 06:37:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
May 2 06:37:24.944643482 (1762h28m44.083627666s) [upload=1550069]: Starting upload
May 2 06:37:24.944719074 (1762h28m44.083703257s) [upload=1550069]: Done starting upload
May 2 06:37:24.944795837 (1762h28m44.083780022s) [upload=1550069]: Uploading segments...
May 2 06:37:24.944950087 (1762h28m44.083934281s) [upload=1550069]: Got next segment. Inline: false
May 2 06:37:24.944987757 (1762h28m44.083971951s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 2 06:37:24.944991635 (1762h28m44.083975829s) [upload=1550069]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 2 06:37:24.967868531 (1762h28m44.106852715s) [seg_pos={0 0}, upload=1550069]: Begin upload segment...
May 2 06:37:24.967900030 (1762h28m44.106884224s) [seg_pos={0 0}, upload=1550069]: Done begin upload segment.
May 2 06:37:24.967941478 (1762h28m44.106925672s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.967961054 (1762h28m44.106945238s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968426717 (1762h28m44.107410901s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968677927 (1762h28m44.107662122s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.968921584 (1762h28m44.107905778s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969175610 (1762h28m44.108159794s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969424817 (1762h28m44.108409002s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.969675077 (1762h28m44.108659271s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.970883050 (1762h28m44.109867234s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971283479 (1762h28m44.110267674s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971569927 (1762h28m44.110554111s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.971877123 (1762h28m44.110861317s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.972245132 (1762h28m44.111229315s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.973347107 (1762h28m44.112331291s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.974344356 (1762h28m44.11332854s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:24.975384385 (1762h28m44.114368579s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Uploading piece...
May 2 06:37:25.051489502 (1762h28m44.190473685s) [upload=1550069]: Next returned nil segment
May 2 06:37:25.051497376 (1762h28m44.190481561s) [upload=1550069]: Waiting for error group managing segments...
May 2 06:37:25.061833845 (1762h28m44.200818029s) [noise=true , address=145.79.227.45:4233 , piece_id=5GYDPGHTCR7E3ABGIQJNI4YVFWZUZV2AUI5KLAYQLI5V4NTEDOGA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.062829531 (1762h28m44.201813705s) [noise=true , address=145.79.227.23:4548 , piece_id=HG6HSXSQGUC3YZ3ETJZ2USPM76UPPN7EXVI3FUMEBHBWQXV4KMSQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063051877 (1762h28m44.202036061s) [noise=true , address=145.79.227.24:4584 , piece_id=74G6ABNWJWC5L6UZLYYYGY7YSNRG5JXDGFZ7TF7IBNV4THODR4LQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063174968 (1762h28m44.202159153s) [noise=true , address=145.79.227.46:4603 , piece_id=RGTCTU6JYLY2DOMC3LVI7SEGWFDUTCI2TVRSBZRQHLVYJJRE2WRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063413927 (1762h28m44.2023981s) [noise=true , address=145.79.227.3:4155 , piece_id=6ZPWT7H6PEWMGR2DTSVSHUOSXJRDM3QI6IEIN2VBDB7EWVTKTUKA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.063469150 (1762h28m44.202453334s) [noise=true , address=145.79.227.39:4016 , piece_id=I3ZPS2CCHHS44TWO6C7FNRRKHJKUWXXKYSWA5ABHPREL4YKWZUOA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.064106304 (1762h28m44.203090487s) [noise=true , address=145.79.227.7:4296 , piece_id=H6W2KK3TXC3U2OLEHHPIAS2JDUMD6AESWOZAX3M2F5SHNKCVILEA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.067754800 (1762h28m44.206738984s) [noise=true , address=145.79.227.40:4052 , piece_id=AX6IS4ZUD3AQZQ375DIEL2BIS4POJW7TG7BIDRYPCEMBGUP6ARTQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.068119153 (1762h28m44.207103338s) [noise=true , address=145.79.227.41:4089 , piece_id=ZR5RDX4G6UPOIPZJI7SMR6BCWWH7I6G6DVP7WQA23PO77F5NHE5A, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.069380707 (1762h28m44.208364891s) [noise=true , address=145.79.227.42:4123 , piece_id=GIRAM6ZGWRWSRUFY2H4S2CGGFKNNBIOI6IT3U6ILN6NEITXAYFOQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:25.073154247 (1762h28m44.212138431s) [noise=true , address=145.79.227.38:4977 , piece_id=MSAKN2TSGOWVYDE6MEK3BP74ACF5ZBTP6GVADCCE6FCIWLW3YLDQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:46.570551051 (1762h29m5.709535235s) [noise=true , address=45.91.116.7:4019 , piece_id=7PTIZG3MP3EXBLBAT2MELMGDRAEWARHTB6Z74GEYGUUJYYTQHQRA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: <nil>
May 2 06:37:54.933039069 (1762h29m14.072023253s) [noise=true , address=45.91.116.10:4085 , piece_id=TZS5KAVPQZW22AFEEEIW2YEIZZXK5J4ZL7SP7HTBQHTXKURV64KA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12vFQZe3CcRH8BwWoRFcNiUbXQwtHdL59hTgGo2H4t2LCLmGiht, address:45.91.116.10:4085): protocol: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:18036->45.91.116.10:4085: use of closed network connection
May 2 06:37:54.933071700 (1762h29m14.072055885s) [noise=true , address=45.91.116.13:4153 , piece_id=PN3KQHZGRSAYDOAHR7GHEIYIMJQT23RQ2WVDGZS7EEFPEJIVLMQQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:12902->45.91.116.13:4153: use of closed network connection
May 2 06:37:54.933117446 (1762h29m14.07210163s) [noise=true , address=45.91.116.8:4046 , piece_id=DIPMCUWF2FJ5S7PTQE4R7DEEU36SSROYV6AWDFLK6AK7ROOQPMEQ, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:129gPpguzPP8UDJEMDM9YPuKXiDVLhijvpeb6VYDMdzyccof35H, address:45.91.116.8:4046): protocol: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:16662->45.91.116.8:4046: use of closed network connection
May 2 06:37:54.933204309 (1762h29m14.072188503s) [noise=true , address=45.91.116.12:4260 , piece_id=I2DFAC2VKGIEIFSOAQRGGKWWX4VL5A2RZV2JJFQABB7HNRYGGAVA, seg_pos={0 0}, upload=1550069]: Done uploading piece. err: ecclient: upload failed (node:12AMEaWMNQU72PZQuRPUKPs5F6baiuynaT5hGRGysiu8cMCPDTr, address:45.91.116.12:4260): protocol: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:24744->45.91.116.12:4260: use of closed network connection
May 2 06:37:54.933228835 (1762h29m14.072213029s) [seg_pos={0 0}, upload=1550069]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
May 2 06:37:54.950192893 (1762h29m14.089177076s) [upload=1550069]: Done uploading segments...
May 2 06:37:54.950209984 (1762h29m14.089194178s) [upload=1550069]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 30.018354787s
core
uplink
us-select-1
|