Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
107.154029ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sat, 11 Apr 2026 00:39:01 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18A5267BE0B3133B Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=EHxVZ6Dz1ML X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5572fe44af148d9d
FAIL (2026-04-11 00:39:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A5267BE0B3133B</RequestId><HostId></HostId></Error>"
Duration: 107.165682ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.674594146s trace:
https://jaeger.dev.storj.io/trace/763dfef2d18cd6e2
FAIL (2026-04-11 00:39:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
, upload=1101192]: Done begin upload segment.
Apr 11 00:35:00.354431566 (1252h26m19.49341576s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.355988042 (1252h26m19.494972236s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356468462 (1252h26m19.495452656s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356759707 (1252h26m19.495743891s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357047146 (1252h26m19.49603134s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357321861 (1252h26m19.496306055s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357587579 (1252h26m19.496571763s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357865299 (1252h26m19.496849493s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358122842 (1252h26m19.497107026s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358132610 (1252h26m19.497116794s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358406383 (1252h26m19.497390577s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358411694 (1252h26m19.497395877s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358709290 (1252h26m19.497693474s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359029180 (1252h26m19.498013364s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359423569 (1252h26m19.498407753s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359757234 (1252h26m19.498741418s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359839047 (1252h26m19.498823242s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.360180568 (1252h26m19.499164751s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.419188463 (1252h26m19.558172648s) [upload=1101192]: Next returned nil segment
Apr 11 00:35:00.419196418 (1252h26m19.558180602s) [upload=1101192]: Waiting for error group managing segments...
Apr 11 00:35:00.432316061 (1252h26m19.571300245s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.635711511 (1252h26m19.774695695s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.637901635 (1252h26m19.776885829s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.934800787 (1252h26m20.073784972s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.939956558 (1252h26m20.078940752s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.940039554 (1252h26m20.079023737s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941150174 (1252h26m20.080134359s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941411514 (1252h26m20.080395698s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941849996 (1252h26m20.08083418s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.960649371 (1252h26m20.099633565s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:01.307829827 (1252h26m20.446814012s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:36:00.327591793 (1252h27m19.466575967s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12bFi2opJ6FejAMwSL2qbqWoCk24QzSjT6xQYE8BytLgVJikZMT, address:145.79.227.19:4089): protocol: rpc: dial tcp 145.79.227.19:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327637769 (1252h27m19.466621964s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA, address:145.79.227.52:4461): protocol: rpc: dial tcp 145.79.227.52:4461: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327731975 (1252h27m19.46671616s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12aExoQdioFcK1qB46HjSQA6jany7ZxxgRYbBcBu75duXBEKWbi, address:145.79.227.13:4829): protocol: rpc: dial tcp 145.79.227.13:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327830250 (1252h27m19.466814424s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1JEqRG4b2YCdARm1eBnCgH4sAW4X7kRykNRZyTstpi8xavLqEg, address:145.79.227.32:4847): protocol: rpc: dial tcp 145.79.227.32:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327875465 (1252h27m19.466859659s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:145.79.227.40:4061): protocol: rpc: dial tcp 145.79.227.40:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328146733 (1252h27m19.467130927s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU, address:145.79.227.36:4542): protocol: rpc: dial tcp 145.79.227.36:4542: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328250037 (1252h27m19.467234211s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1dCvsMCm5ZRmWVqP1zr9noHVuPeyrXHjpRvdHnKoAZqqt6knx, address:145.79.227.29:4973): protocol: rpc: dial tcp 145.79.227.29:4973: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328267800 (1252h27m19.467251985s) [seg_pos={0 0}, upload=1101192]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:36:00.349355634 (1252h27m19.488339828s) [upload=1101192]: Done uploading segments...
Apr 11 00:36:00.349374158 (1252h27m19.488358352s) [upload=1101192]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 1.674609516s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
116.723189ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Type=application/xml X-Request-Id=PDGDmHPj1Cm X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18A526785A4E5488 Date=Sat, 11 Apr 2026 00:38:46 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/78f24941a46a893e
FAIL (2026-04-11 00:38:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A526785A4E5488</RequestId><HostId></HostId></Error>"
Duration: 116.734751ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
626.868942ms trace:
https://jaeger.dev.storj.io/trace/63c6acf9ae01bec7
FAIL (2026-04-11 00:38:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 626.886425ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.195866024s trace:
https://jaeger.dev.storj.io/trace/23afef2367e31b52
FAIL (2026-04-11 00:38:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.195877665s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
112.535773ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Content-Length=274 X-Amz-Request-Id=18A52674B08A8244 X-Request-Id=fLQaZpApoDz X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:38:30 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/f59edb33e263b20
FAIL (2026-04-11 00:38:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A52674B08A8244</RequestId><HostId></HostId></Error>"
Duration: 112.551543ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.12264124s trace:
https://jaeger.dev.storj.io/trace/763dfef2d18cd6e2
FAIL (2026-04-11 00:38:27 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
, upload=1101192]: Done begin upload segment.
Apr 11 00:35:00.354431566 (1252h26m19.49341576s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.355988042 (1252h26m19.494972236s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356468462 (1252h26m19.495452656s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356759707 (1252h26m19.495743891s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357047146 (1252h26m19.49603134s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357321861 (1252h26m19.496306055s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357587579 (1252h26m19.496571763s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357865299 (1252h26m19.496849493s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358122842 (1252h26m19.497107026s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358132610 (1252h26m19.497116794s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358406383 (1252h26m19.497390577s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358411694 (1252h26m19.497395877s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358709290 (1252h26m19.497693474s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359029180 (1252h26m19.498013364s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359423569 (1252h26m19.498407753s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359757234 (1252h26m19.498741418s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359839047 (1252h26m19.498823242s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.360180568 (1252h26m19.499164751s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.419188463 (1252h26m19.558172648s) [upload=1101192]: Next returned nil segment
Apr 11 00:35:00.419196418 (1252h26m19.558180602s) [upload=1101192]: Waiting for error group managing segments...
Apr 11 00:35:00.432316061 (1252h26m19.571300245s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.635711511 (1252h26m19.774695695s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.637901635 (1252h26m19.776885829s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.934800787 (1252h26m20.073784972s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.939956558 (1252h26m20.078940752s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.940039554 (1252h26m20.079023737s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941150174 (1252h26m20.080134359s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941411514 (1252h26m20.080395698s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941849996 (1252h26m20.08083418s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.960649371 (1252h26m20.099633565s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:01.307829827 (1252h26m20.446814012s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:36:00.327591793 (1252h27m19.466575967s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12bFi2opJ6FejAMwSL2qbqWoCk24QzSjT6xQYE8BytLgVJikZMT, address:145.79.227.19:4089): protocol: rpc: dial tcp 145.79.227.19:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327637769 (1252h27m19.466621964s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA, address:145.79.227.52:4461): protocol: rpc: dial tcp 145.79.227.52:4461: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327731975 (1252h27m19.46671616s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12aExoQdioFcK1qB46HjSQA6jany7ZxxgRYbBcBu75duXBEKWbi, address:145.79.227.13:4829): protocol: rpc: dial tcp 145.79.227.13:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327830250 (1252h27m19.466814424s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1JEqRG4b2YCdARm1eBnCgH4sAW4X7kRykNRZyTstpi8xavLqEg, address:145.79.227.32:4847): protocol: rpc: dial tcp 145.79.227.32:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327875465 (1252h27m19.466859659s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:145.79.227.40:4061): protocol: rpc: dial tcp 145.79.227.40:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328146733 (1252h27m19.467130927s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU, address:145.79.227.36:4542): protocol: rpc: dial tcp 145.79.227.36:4542: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328250037 (1252h27m19.467234211s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1dCvsMCm5ZRmWVqP1zr9noHVuPeyrXHjpRvdHnKoAZqqt6knx, address:145.79.227.29:4973): protocol: rpc: dial tcp 145.79.227.29:4973: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328267800 (1252h27m19.467251985s) [seg_pos={0 0}, upload=1101192]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:36:00.349355634 (1252h27m19.488339828s) [upload=1101192]: Done uploading segments...
Apr 11 00:36:00.349374158 (1252h27m19.488358352s) [upload=1101192]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 1.122672338s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.305761ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18A52673129625F3 X-Request-Id=BbwvryhEgGz Accept-Ranges=bytes X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:38:23 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/4dedadee1fce2b74
FAIL (2026-04-11 00:38:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A52673129625F3</RequestId><HostId></HostId></Error>"
Duration: 26.3265ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...] duration:
335.509528ms trace:
https://jaeger.dev.storj.io/trace/246b0cf010fe0949
FAIL (2026-04-11 00:38:16 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
26m58.524717394s) [noise=true , address=145.79.227.10:4404 , piece_id=VCYHMNYKDFFGRYJNHGJLT4YIBQPS6AHTJLI77Y4AR2RGIWLWF52A, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.386235481 (1252h26m58.525219685s) [noise=true , address=77.90.31.13:4626 , piece_id=MLPK7UBNLEO7OLG367ZD6DWMFTQNXAYZ5CE73L2HBX5BUDNNPVRA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.387577275 (1252h26m58.52656147s) [noise=true , address=145.79.227.52:4445 , piece_id=YNXTHR6G2VSWZORO4ZHZDRZO5KDQDPGPXAQ7CTZPRG7CH7PM24PQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.387788552 (1252h26m58.526772746s) [noise=true , address=145.79.227.51:4412 , piece_id=FU3QNM3JOCZSXA2YABOSSOZPXBWEKDVTZFSOYXTA52YG3GQ3PCYQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388213427 (1252h26m58.527197631s) [noise=true , address=77.90.31.14:4666 , piece_id=XEXKCHNUQQRMTBP3I5EXDDEVCTD47N5PXBTNHZUH44R75XMSEH3Q, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388240277 (1252h26m58.527224471s) [noise=true , address=145.79.227.9:4370 , piece_id=75WD2SGLBT3Y5OWO7GYIV64NOUKWZQZNIDXOV2MRRWOREOWM5KAQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388737148 (1252h26m58.527721343s) [noise=true , address=145.79.227.8:4335 , piece_id=WH3U7VO5KYL4POVCCXQU4L2AYNQ6TXL3F2ZT3N3XPVBFP4RZ6KKA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388783716 (1252h26m58.52776792s) [noise=true , address=145.79.227.19:4080 , piece_id=4EZ66JMT5KDVFLKFLLNPBON2AGJJ7V63IEJ3UC5ZCMHW72C6KT6A, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389095912 (1252h26m58.528080095s) [noise=true , address=145.79.227.11:4731 , piece_id=VDC3IRBVR34ROMWITOC7INZKFVPIY6P3SIJ4Y5T5UQDDIE2F5OIQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389226174 (1252h26m58.528210378s) [noise=true , address=145.79.227.39:4018 , piece_id=AHG5ROZ5MJNH2J4RALU647NFVND6RYSSQKOIN62IXJL7APNF3PLQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389631124 (1252h26m58.528615308s) [noise=true , address=145.79.227.42:4126 , piece_id=3SOIHC6OEKURVHGYN7HTBCT3JRZNF5WZ6H3KWSXDKL7LQDKWLHDQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389748964 (1252h26m58.528733169s) [noise=true , address=145.79.227.7:4296 , piece_id=AGLZROZVCWRJBGTJXJMW4Y7HURG3WB6OEZGNCCD2BHFNVUGQQ6UQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.390167329 (1252h26m58.529151513s) [noise=true , address=145.79.227.26:4658 , piece_id=PT5ZSW5VA6LSGWYET4PEP4OBAEQXSSYSWXKWPELWI5XYFGLOU3IA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.390548703 (1252h26m58.529532897s) [noise=true , address=145.79.227.25:4620 , piece_id=PQEN3BWUDSCGICRLUU4IKYHPTT7Q3CEZRYMOBMHORFYEV3B2N7XQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.458961811 (1252h26m58.597945986s) [upload=1101200]: Next returned nil segment
Apr 11 00:35:39.458969326 (1252h26m58.597953499s) [upload=1101200]: Waiting for error group managing segments...
Apr 11 00:35:39.469204574 (1252h26m58.608188757s) [noise=true , address=77.90.31.14:4666 , piece_id=XEXKCHNUQQRMTBP3I5EXDDEVCTD47N5PXBTNHZUH44R75XMSEH3Q, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:39.480291549 (1252h26m58.619275722s) [noise=true , address=77.90.31.13:4626 , piece_id=MLPK7UBNLEO7OLG367ZD6DWMFTQNXAYZ5CE73L2HBX5BUDNNPVRA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:39.488543230 (1252h26m58.627527414s) [noise=true , address=77.90.31.11:4556 , piece_id=MK5ODY7DGS6QYT4KMH3ZO2KQYMSULWSATZSTC2ZORTBSKPLZLDTA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:54.882618410 (1252h27m14.021602593s) [noise=true , address=145.79.227.52:4445 , piece_id=YNXTHR6G2VSWZORO4ZHZDRZO5KDQDPGPXAQ7CTZPRG7CH7PM24PQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo, address:145.79.227.52:4445): protocol: rpc: dial tcp 145.79.227.52:4445: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344483249 (1252h27m28.483467443s) [noise=true , address=145.79.227.19:4080 , piece_id=4EZ66JMT5KDVFLKFLLNPBON2AGJJ7V63IEJ3UC5ZCMHW72C6KT6A, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: rpc: dial tcp 145.79.227.19:4080: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344573928 (1252h27m28.483558122s) [noise=true , address=145.79.227.39:4018 , piece_id=AHG5ROZ5MJNH2J4RALU647NFVND6RYSSQKOIN62IXJL7APNF3PLQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12YcYgDWq2k7F9fwpdLAGNkrskGEUURe6QuRed7mRjMTdNHEQ8D, address:145.79.227.39:4018): protocol: rpc: dial tcp 145.79.227.39:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344717436 (1252h27m28.48370163s) [noise=true , address=145.79.227.42:4126 , piece_id=3SOIHC6OEKURVHGYN7HTBCT3JRZNF5WZ6H3KWSXDKL7LQDKWLHDQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344727846 (1252h27m28.48371204s) [noise=true , address=145.79.227.22:4510 , piece_id=PQM4DMJOIMVQXEDGXJBOEVW5ZUTVGRQHOXXOWTPHCZ7JJFHACNZQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9, address:145.79.227.22:4510): protocol: rpc: dial tcp 145.79.227.22:4510: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344829898 (1252h27m28.483814081s) [noise=true , address=145.79.227.11:4731 , piece_id=VDC3IRBVR34ROMWITOC7INZKFVPIY6P3SIJ4Y5T5UQDDIE2F5OIQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:145.79.227.11:4731): protocol: rpc: dial tcp 145.79.227.11:4731: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344875202 (1252h27m28.483859386s) [noise=true , address=145.79.227.7:4296 , piece_id=AGLZROZVCWRJBGTJXJMW4Y7HURG3WB6OEZGNCCD2BHFNVUGQQ6UQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1, address:145.79.227.7:4296): protocol: rpc: dial tcp 145.79.227.7:4296: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345017278 (1252h27m28.484001493s) [noise=true , address=145.79.227.9:4370 , piece_id=75WD2SGLBT3Y5OWO7GYIV64NOUKWZQZNIDXOV2MRRWOREOWM5KAQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12SXZN7WJvcHys9BRd4Lq8NAZ3MSgHf9ZVv7SgaiJNRosdmFVpm, address:145.79.227.9:4370): protocol: rpc: dial tcp 145.79.227.9:4370: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345050681 (1252h27m28.484034895s) [noise=true , address=145.79.227.51:4412 , piece_id=FU3QNM3JOCZSXA2YABOSSOZPXBWEKDVTZFSOYXTA52YG3GQ3PCYQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12vBvEfCYZxsv17cVsQTbCQ4YjZfiD4RXjWyz7Ka9ZZrtvzC7SS, address:145.79.227.51:4412): protocol: rpc: dial tcp 145.79.227.51:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345165256 (1252h27m28.48414944s) [noise=true , address=145.79.227.8:4335 , piece_id=WH3U7VO5KYL4POVCCXQU4L2AYNQ6TXL3F2ZT3N3XPVBFP4RZ6KKA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN, address:145.79.227.8:4335): protocol: rpc: dial tcp 145.79.227.8:4335: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345338371 (1252h27m28.484322554s) [noise=true , address=145.79.227.26:4658 , piece_id=PT5ZSW5VA6LSGWYET4PEP4OBAEQXSSYSWXKWPELWI5XYFGLOU3IA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1gcSHRechDzTDwivRoAwNFfNj5Zjqvi6oJwVqzbCQinwgWtpPr, address:145.79.227.26:4658): protocol: rpc: dial tcp 145.79.227.26:4658: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345505043 (1252h27m28.484489227s) [noise=true , address=145.79.227.10:4404 , piece_id=VCYHMNYKDFFGRYJNHGJLT4YIBQPS6AHTJLI77Y4AR2RGIWLWF52A, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: rpc: dial tcp 145.79.227.10:4404: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345654022 (1252h27m28.484638206s) [noise=true , address=145.79.227.25:4620 , piece_id=PQEN3BWUDSCGICRLUU4IKYHPTT7Q3CEZRYMOBMHORFYEV3B2N7XQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev, address:145.79.227.25:4620): protocol: rpc: dial tcp 145.79.227.25:4620: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345698466 (1252h27m28.48468265s) [seg_pos={0 0}, upload=1101200]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Apr 11 00:36:09.371563390 (1252h27m28.510547573s) [upload=1101200]: Done uploading segments...
Apr 11 00:36:09.371577836 (1252h27m28.510562021s) [upload=1101200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 335.527772ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
109.715607ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18A526710731EEE8 X-Request-Id=YN85px3uxcw X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj Date=Sat, 11 Apr 2026 00:38:14 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2fc7dbfe8b98b45e
FAIL (2026-04-11 00:38:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A526710731EEE8</RequestId><HostId></HostId></Error>"
Duration: 109.733652ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.496624417s trace:
https://jaeger.dev.storj.io/trace/763dfef2d18cd6e2
FAIL (2026-04-11 00:38:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
, upload=1101192]: Done begin upload segment.
Apr 11 00:35:00.354431566 (1252h26m19.49341576s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.355988042 (1252h26m19.494972236s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356468462 (1252h26m19.495452656s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356759707 (1252h26m19.495743891s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357047146 (1252h26m19.49603134s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357321861 (1252h26m19.496306055s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357587579 (1252h26m19.496571763s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357865299 (1252h26m19.496849493s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358122842 (1252h26m19.497107026s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358132610 (1252h26m19.497116794s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358406383 (1252h26m19.497390577s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358411694 (1252h26m19.497395877s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358709290 (1252h26m19.497693474s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359029180 (1252h26m19.498013364s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359423569 (1252h26m19.498407753s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359757234 (1252h26m19.498741418s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359839047 (1252h26m19.498823242s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.360180568 (1252h26m19.499164751s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.419188463 (1252h26m19.558172648s) [upload=1101192]: Next returned nil segment
Apr 11 00:35:00.419196418 (1252h26m19.558180602s) [upload=1101192]: Waiting for error group managing segments...
Apr 11 00:35:00.432316061 (1252h26m19.571300245s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.635711511 (1252h26m19.774695695s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.637901635 (1252h26m19.776885829s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.934800787 (1252h26m20.073784972s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.939956558 (1252h26m20.078940752s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.940039554 (1252h26m20.079023737s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941150174 (1252h26m20.080134359s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941411514 (1252h26m20.080395698s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941849996 (1252h26m20.08083418s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.960649371 (1252h26m20.099633565s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:01.307829827 (1252h26m20.446814012s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:36:00.327591793 (1252h27m19.466575967s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12bFi2opJ6FejAMwSL2qbqWoCk24QzSjT6xQYE8BytLgVJikZMT, address:145.79.227.19:4089): protocol: rpc: dial tcp 145.79.227.19:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327637769 (1252h27m19.466621964s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA, address:145.79.227.52:4461): protocol: rpc: dial tcp 145.79.227.52:4461: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327731975 (1252h27m19.46671616s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12aExoQdioFcK1qB46HjSQA6jany7ZxxgRYbBcBu75duXBEKWbi, address:145.79.227.13:4829): protocol: rpc: dial tcp 145.79.227.13:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327830250 (1252h27m19.466814424s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1JEqRG4b2YCdARm1eBnCgH4sAW4X7kRykNRZyTstpi8xavLqEg, address:145.79.227.32:4847): protocol: rpc: dial tcp 145.79.227.32:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327875465 (1252h27m19.466859659s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:145.79.227.40:4061): protocol: rpc: dial tcp 145.79.227.40:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328146733 (1252h27m19.467130927s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU, address:145.79.227.36:4542): protocol: rpc: dial tcp 145.79.227.36:4542: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328250037 (1252h27m19.467234211s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1dCvsMCm5ZRmWVqP1zr9noHVuPeyrXHjpRvdHnKoAZqqt6knx, address:145.79.227.29:4973): protocol: rpc: dial tcp 145.79.227.29:4973: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328267800 (1252h27m19.467251985s) [seg_pos={0 0}, upload=1101192]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:36:00.349355634 (1252h27m19.488339828s) [upload=1101192]: Done uploading segments...
Apr 11 00:36:00.349374158 (1252h27m19.488358352s) [upload=1101192]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 1.496637181s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.686460312s trace:
https://jaeger.dev.storj.io/trace/63c6acf9ae01bec7
FAIL (2026-04-11 00:38:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.686492693s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
906.297988ms trace:
https://jaeger.dev.storj.io/trace/75735e15af9b9b94
FAIL (2026-04-11 00:38:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 906.312286ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
110.710714ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18A5266F1EDD27D6 X-Request-Id=WJ4JVLbtC2V X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Date=Sat, 11 Apr 2026 00:38:06 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/2155e1ab243f6fa8
FAIL (2026-04-11 00:38:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A5266F1EDD27D6</RequestId><HostId></HostId></Error>"
Duration: 110.760789ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
861.667182ms trace:
https://jaeger.dev.storj.io/trace/23afef2367e31b52
FAIL (2026-04-11 00:37:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 861.692218ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
106.966849ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:37:55 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18A5266C8895937E X-Request-Id=BaF8LGs1PpT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/579f32cf21daaecc
FAIL (2026-04-11 00:37:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A5266C8895937E</RequestId><HostId></HostId></Error>"
Duration: 106.981826ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
117.061082ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Sat, 11 Apr 2026 00:37:51 GMT Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18A5266B9C8888E9 X-Request-Id=Lx6iz3XUkPY X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2c22aacc6007411c
FAIL (2026-04-11 00:37:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A5266B9C8888E9</RequestId><HostId></HostId></Error>"
Duration: 117.085577ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.5582669s trace:
https://jaeger.dev.storj.io/trace/763dfef2d18cd6e2
FAIL (2026-04-11 00:37:40 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
, upload=1101192]: Done begin upload segment.
Apr 11 00:35:00.354431566 (1252h26m19.49341576s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.355988042 (1252h26m19.494972236s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356468462 (1252h26m19.495452656s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356759707 (1252h26m19.495743891s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357047146 (1252h26m19.49603134s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357321861 (1252h26m19.496306055s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357587579 (1252h26m19.496571763s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357865299 (1252h26m19.496849493s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358122842 (1252h26m19.497107026s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358132610 (1252h26m19.497116794s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358406383 (1252h26m19.497390577s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358411694 (1252h26m19.497395877s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358709290 (1252h26m19.497693474s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359029180 (1252h26m19.498013364s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359423569 (1252h26m19.498407753s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359757234 (1252h26m19.498741418s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359839047 (1252h26m19.498823242s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.360180568 (1252h26m19.499164751s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.419188463 (1252h26m19.558172648s) [upload=1101192]: Next returned nil segment
Apr 11 00:35:00.419196418 (1252h26m19.558180602s) [upload=1101192]: Waiting for error group managing segments...
Apr 11 00:35:00.432316061 (1252h26m19.571300245s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.635711511 (1252h26m19.774695695s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.637901635 (1252h26m19.776885829s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.934800787 (1252h26m20.073784972s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.939956558 (1252h26m20.078940752s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.940039554 (1252h26m20.079023737s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941150174 (1252h26m20.080134359s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941411514 (1252h26m20.080395698s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941849996 (1252h26m20.08083418s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.960649371 (1252h26m20.099633565s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:01.307829827 (1252h26m20.446814012s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:36:00.327591793 (1252h27m19.466575967s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12bFi2opJ6FejAMwSL2qbqWoCk24QzSjT6xQYE8BytLgVJikZMT, address:145.79.227.19:4089): protocol: rpc: dial tcp 145.79.227.19:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327637769 (1252h27m19.466621964s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA, address:145.79.227.52:4461): protocol: rpc: dial tcp 145.79.227.52:4461: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327731975 (1252h27m19.46671616s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12aExoQdioFcK1qB46HjSQA6jany7ZxxgRYbBcBu75duXBEKWbi, address:145.79.227.13:4829): protocol: rpc: dial tcp 145.79.227.13:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327830250 (1252h27m19.466814424s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1JEqRG4b2YCdARm1eBnCgH4sAW4X7kRykNRZyTstpi8xavLqEg, address:145.79.227.32:4847): protocol: rpc: dial tcp 145.79.227.32:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327875465 (1252h27m19.466859659s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:145.79.227.40:4061): protocol: rpc: dial tcp 145.79.227.40:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328146733 (1252h27m19.467130927s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU, address:145.79.227.36:4542): protocol: rpc: dial tcp 145.79.227.36:4542: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328250037 (1252h27m19.467234211s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1dCvsMCm5ZRmWVqP1zr9noHVuPeyrXHjpRvdHnKoAZqqt6knx, address:145.79.227.29:4973): protocol: rpc: dial tcp 145.79.227.29:4973: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328267800 (1252h27m19.467251985s) [seg_pos={0 0}, upload=1101192]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:36:00.349355634 (1252h27m19.488339828s) [upload=1101192]: Done uploading segments...
Apr 11 00:36:00.349374158 (1252h27m19.488358352s) [upload=1101192]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 1.558290214s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.289695ms remote:
"tcp:45.38.24.2:443" response headers:
X-Amz-Request-Id=18A526666E545D19 X-Request-Id=cXoVXEA5rZ7 X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:37:29 GMT Accept-Ranges=bytes Server=Storj Vary=Origin Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/15c6ebd13c932a4
FAIL (2026-04-11 00:37:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A526666E545D19</RequestId><HostId></HostId></Error>"
Duration: 14.309632ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
110.359706ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Request-Id=JJu9jjmteU6 Date=Sat, 11 Apr 2026 00:37:29 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18A526667F76BAB9 X-Xss-Protection=1; mode=block Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/264b12af5adf62da
FAIL (2026-04-11 00:37:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A526667F76BAB9</RequestId><HostId></HostId></Error>"
Duration: 110.380695ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
127.530841ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18A526658CB05FD9 X-Request-Id=boBDjdAVbd4 Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:37:25 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/75fe9229bae8e676
FAIL (2026-04-11 00:37:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A526658CB05FD9</RequestId><HostId></HostId></Error>"
Duration: 127.547512ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
403.376173ms trace:
https://jaeger.dev.storj.io/trace/63c6acf9ae01bec7
FAIL (2026-04-11 00:37:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 403.448299ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................................XX..] duration:
353.192371ms trace:
https://jaeger.dev.storj.io/trace/246b0cf010fe0949
FAIL (2026-04-11 00:37:15 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
26m58.524717394s) [noise=true , address=145.79.227.10:4404 , piece_id=VCYHMNYKDFFGRYJNHGJLT4YIBQPS6AHTJLI77Y4AR2RGIWLWF52A, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.386235481 (1252h26m58.525219685s) [noise=true , address=77.90.31.13:4626 , piece_id=MLPK7UBNLEO7OLG367ZD6DWMFTQNXAYZ5CE73L2HBX5BUDNNPVRA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.387577275 (1252h26m58.52656147s) [noise=true , address=145.79.227.52:4445 , piece_id=YNXTHR6G2VSWZORO4ZHZDRZO5KDQDPGPXAQ7CTZPRG7CH7PM24PQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.387788552 (1252h26m58.526772746s) [noise=true , address=145.79.227.51:4412 , piece_id=FU3QNM3JOCZSXA2YABOSSOZPXBWEKDVTZFSOYXTA52YG3GQ3PCYQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388213427 (1252h26m58.527197631s) [noise=true , address=77.90.31.14:4666 , piece_id=XEXKCHNUQQRMTBP3I5EXDDEVCTD47N5PXBTNHZUH44R75XMSEH3Q, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388240277 (1252h26m58.527224471s) [noise=true , address=145.79.227.9:4370 , piece_id=75WD2SGLBT3Y5OWO7GYIV64NOUKWZQZNIDXOV2MRRWOREOWM5KAQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388737148 (1252h26m58.527721343s) [noise=true , address=145.79.227.8:4335 , piece_id=WH3U7VO5KYL4POVCCXQU4L2AYNQ6TXL3F2ZT3N3XPVBFP4RZ6KKA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388783716 (1252h26m58.52776792s) [noise=true , address=145.79.227.19:4080 , piece_id=4EZ66JMT5KDVFLKFLLNPBON2AGJJ7V63IEJ3UC5ZCMHW72C6KT6A, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389095912 (1252h26m58.528080095s) [noise=true , address=145.79.227.11:4731 , piece_id=VDC3IRBVR34ROMWITOC7INZKFVPIY6P3SIJ4Y5T5UQDDIE2F5OIQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389226174 (1252h26m58.528210378s) [noise=true , address=145.79.227.39:4018 , piece_id=AHG5ROZ5MJNH2J4RALU647NFVND6RYSSQKOIN62IXJL7APNF3PLQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389631124 (1252h26m58.528615308s) [noise=true , address=145.79.227.42:4126 , piece_id=3SOIHC6OEKURVHGYN7HTBCT3JRZNF5WZ6H3KWSXDKL7LQDKWLHDQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389748964 (1252h26m58.528733169s) [noise=true , address=145.79.227.7:4296 , piece_id=AGLZROZVCWRJBGTJXJMW4Y7HURG3WB6OEZGNCCD2BHFNVUGQQ6UQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.390167329 (1252h26m58.529151513s) [noise=true , address=145.79.227.26:4658 , piece_id=PT5ZSW5VA6LSGWYET4PEP4OBAEQXSSYSWXKWPELWI5XYFGLOU3IA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.390548703 (1252h26m58.529532897s) [noise=true , address=145.79.227.25:4620 , piece_id=PQEN3BWUDSCGICRLUU4IKYHPTT7Q3CEZRYMOBMHORFYEV3B2N7XQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.458961811 (1252h26m58.597945986s) [upload=1101200]: Next returned nil segment
Apr 11 00:35:39.458969326 (1252h26m58.597953499s) [upload=1101200]: Waiting for error group managing segments...
Apr 11 00:35:39.469204574 (1252h26m58.608188757s) [noise=true , address=77.90.31.14:4666 , piece_id=XEXKCHNUQQRMTBP3I5EXDDEVCTD47N5PXBTNHZUH44R75XMSEH3Q, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:39.480291549 (1252h26m58.619275722s) [noise=true , address=77.90.31.13:4626 , piece_id=MLPK7UBNLEO7OLG367ZD6DWMFTQNXAYZ5CE73L2HBX5BUDNNPVRA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:39.488543230 (1252h26m58.627527414s) [noise=true , address=77.90.31.11:4556 , piece_id=MK5ODY7DGS6QYT4KMH3ZO2KQYMSULWSATZSTC2ZORTBSKPLZLDTA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:54.882618410 (1252h27m14.021602593s) [noise=true , address=145.79.227.52:4445 , piece_id=YNXTHR6G2VSWZORO4ZHZDRZO5KDQDPGPXAQ7CTZPRG7CH7PM24PQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo, address:145.79.227.52:4445): protocol: rpc: dial tcp 145.79.227.52:4445: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344483249 (1252h27m28.483467443s) [noise=true , address=145.79.227.19:4080 , piece_id=4EZ66JMT5KDVFLKFLLNPBON2AGJJ7V63IEJ3UC5ZCMHW72C6KT6A, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: rpc: dial tcp 145.79.227.19:4080: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344573928 (1252h27m28.483558122s) [noise=true , address=145.79.227.39:4018 , piece_id=AHG5ROZ5MJNH2J4RALU647NFVND6RYSSQKOIN62IXJL7APNF3PLQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12YcYgDWq2k7F9fwpdLAGNkrskGEUURe6QuRed7mRjMTdNHEQ8D, address:145.79.227.39:4018): protocol: rpc: dial tcp 145.79.227.39:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344717436 (1252h27m28.48370163s) [noise=true , address=145.79.227.42:4126 , piece_id=3SOIHC6OEKURVHGYN7HTBCT3JRZNF5WZ6H3KWSXDKL7LQDKWLHDQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344727846 (1252h27m28.48371204s) [noise=true , address=145.79.227.22:4510 , piece_id=PQM4DMJOIMVQXEDGXJBOEVW5ZUTVGRQHOXXOWTPHCZ7JJFHACNZQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9, address:145.79.227.22:4510): protocol: rpc: dial tcp 145.79.227.22:4510: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344829898 (1252h27m28.483814081s) [noise=true , address=145.79.227.11:4731 , piece_id=VDC3IRBVR34ROMWITOC7INZKFVPIY6P3SIJ4Y5T5UQDDIE2F5OIQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:145.79.227.11:4731): protocol: rpc: dial tcp 145.79.227.11:4731: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344875202 (1252h27m28.483859386s) [noise=true , address=145.79.227.7:4296 , piece_id=AGLZROZVCWRJBGTJXJMW4Y7HURG3WB6OEZGNCCD2BHFNVUGQQ6UQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1, address:145.79.227.7:4296): protocol: rpc: dial tcp 145.79.227.7:4296: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345017278 (1252h27m28.484001493s) [noise=true , address=145.79.227.9:4370 , piece_id=75WD2SGLBT3Y5OWO7GYIV64NOUKWZQZNIDXOV2MRRWOREOWM5KAQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12SXZN7WJvcHys9BRd4Lq8NAZ3MSgHf9ZVv7SgaiJNRosdmFVpm, address:145.79.227.9:4370): protocol: rpc: dial tcp 145.79.227.9:4370: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345050681 (1252h27m28.484034895s) [noise=true , address=145.79.227.51:4412 , piece_id=FU3QNM3JOCZSXA2YABOSSOZPXBWEKDVTZFSOYXTA52YG3GQ3PCYQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12vBvEfCYZxsv17cVsQTbCQ4YjZfiD4RXjWyz7Ka9ZZrtvzC7SS, address:145.79.227.51:4412): protocol: rpc: dial tcp 145.79.227.51:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345165256 (1252h27m28.48414944s) [noise=true , address=145.79.227.8:4335 , piece_id=WH3U7VO5KYL4POVCCXQU4L2AYNQ6TXL3F2ZT3N3XPVBFP4RZ6KKA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN, address:145.79.227.8:4335): protocol: rpc: dial tcp 145.79.227.8:4335: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345338371 (1252h27m28.484322554s) [noise=true , address=145.79.227.26:4658 , piece_id=PT5ZSW5VA6LSGWYET4PEP4OBAEQXSSYSWXKWPELWI5XYFGLOU3IA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1gcSHRechDzTDwivRoAwNFfNj5Zjqvi6oJwVqzbCQinwgWtpPr, address:145.79.227.26:4658): protocol: rpc: dial tcp 145.79.227.26:4658: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345505043 (1252h27m28.484489227s) [noise=true , address=145.79.227.10:4404 , piece_id=VCYHMNYKDFFGRYJNHGJLT4YIBQPS6AHTJLI77Y4AR2RGIWLWF52A, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: rpc: dial tcp 145.79.227.10:4404: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345654022 (1252h27m28.484638206s) [noise=true , address=145.79.227.25:4620 , piece_id=PQEN3BWUDSCGICRLUU4IKYHPTT7Q3CEZRYMOBMHORFYEV3B2N7XQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev, address:145.79.227.25:4620): protocol: rpc: dial tcp 145.79.227.25:4620: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345698466 (1252h27m28.48468265s) [seg_pos={0 0}, upload=1101200]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Apr 11 00:36:09.371563390 (1252h27m28.510547573s) [upload=1101200]: Done uploading segments...
Apr 11 00:36:09.371577836 (1252h27m28.510562021s) [upload=1101200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 353.21361ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
115.856475ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18A52662E3F1F14B X-Xss-Protection=1; mode=block Accept-Ranges=bytes X-Request-Id=T31CG55brpN Date=Sat, 11 Apr 2026 00:37:14 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/632037190647c6dd
FAIL (2026-04-11 00:37:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A52662E3F1F14B</RequestId><HostId></HostId></Error>"
Duration: 115.874369ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.20952189s trace:
https://jaeger.dev.storj.io/trace/23afef2367e31b52
FAIL (2026-04-11 00:37:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.209543531s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
1.600534878s trace:
https://jaeger.dev.storj.io/trace/75735e15af9b9b94
FAIL (2026-04-11 00:36:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.600560476s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.064672362s trace:
https://jaeger.dev.storj.io/trace/763dfef2d18cd6e2
FAIL (2026-04-11 00:36:54 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
, upload=1101192]: Done begin upload segment.
Apr 11 00:35:00.354431566 (1252h26m19.49341576s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.355988042 (1252h26m19.494972236s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356468462 (1252h26m19.495452656s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356759707 (1252h26m19.495743891s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357047146 (1252h26m19.49603134s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357321861 (1252h26m19.496306055s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357587579 (1252h26m19.496571763s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357865299 (1252h26m19.496849493s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358122842 (1252h26m19.497107026s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358132610 (1252h26m19.497116794s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358406383 (1252h26m19.497390577s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358411694 (1252h26m19.497395877s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358709290 (1252h26m19.497693474s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359029180 (1252h26m19.498013364s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359423569 (1252h26m19.498407753s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359757234 (1252h26m19.498741418s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359839047 (1252h26m19.498823242s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.360180568 (1252h26m19.499164751s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.419188463 (1252h26m19.558172648s) [upload=1101192]: Next returned nil segment
Apr 11 00:35:00.419196418 (1252h26m19.558180602s) [upload=1101192]: Waiting for error group managing segments...
Apr 11 00:35:00.432316061 (1252h26m19.571300245s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.635711511 (1252h26m19.774695695s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.637901635 (1252h26m19.776885829s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.934800787 (1252h26m20.073784972s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.939956558 (1252h26m20.078940752s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.940039554 (1252h26m20.079023737s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941150174 (1252h26m20.080134359s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941411514 (1252h26m20.080395698s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941849996 (1252h26m20.08083418s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.960649371 (1252h26m20.099633565s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:01.307829827 (1252h26m20.446814012s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:36:00.327591793 (1252h27m19.466575967s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12bFi2opJ6FejAMwSL2qbqWoCk24QzSjT6xQYE8BytLgVJikZMT, address:145.79.227.19:4089): protocol: rpc: dial tcp 145.79.227.19:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327637769 (1252h27m19.466621964s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA, address:145.79.227.52:4461): protocol: rpc: dial tcp 145.79.227.52:4461: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327731975 (1252h27m19.46671616s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12aExoQdioFcK1qB46HjSQA6jany7ZxxgRYbBcBu75duXBEKWbi, address:145.79.227.13:4829): protocol: rpc: dial tcp 145.79.227.13:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327830250 (1252h27m19.466814424s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1JEqRG4b2YCdARm1eBnCgH4sAW4X7kRykNRZyTstpi8xavLqEg, address:145.79.227.32:4847): protocol: rpc: dial tcp 145.79.227.32:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327875465 (1252h27m19.466859659s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:145.79.227.40:4061): protocol: rpc: dial tcp 145.79.227.40:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328146733 (1252h27m19.467130927s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU, address:145.79.227.36:4542): protocol: rpc: dial tcp 145.79.227.36:4542: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328250037 (1252h27m19.467234211s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1dCvsMCm5ZRmWVqP1zr9noHVuPeyrXHjpRvdHnKoAZqqt6knx, address:145.79.227.29:4973): protocol: rpc: dial tcp 145.79.227.29:4973: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328267800 (1252h27m19.467251985s) [seg_pos={0 0}, upload=1101192]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:36:00.349355634 (1252h27m19.488339828s) [upload=1101192]: Done uploading segments...
Apr 11 00:36:00.349374158 (1252h27m19.488358352s) [upload=1101192]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 2.064695836s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
108.50503ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=18A5265CC78041B6 X-Request-Id=bDSDZ6PFCqw Date=Sat, 11 Apr 2026 00:36:47 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5a6f6f2e2aca6bb9
FAIL (2026-04-11 00:36:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A5265CC78041B6</RequestId><HostId></HostId></Error>"
Duration: 108.5162ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
125.03299ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=KLu2HDyiyV3 Date=Sat, 11 Apr 2026 00:36:47 GMT Content-Length=274 Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18A5265CC279BE92 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/129f55b31db791cf
FAIL (2026-04-11 00:36:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A5265CC279BE92</RequestId><HostId></HostId></Error>"
Duration: 125.043911ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
865.889292ms trace:
https://jaeger.dev.storj.io/trace/63c6acf9ae01bec7
FAIL (2026-04-11 00:36:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 865.90938ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
7.344614331s trace:
https://jaeger.dev.storj.io/trace/63c6acf9ae01bec7
FAIL (2026-04-11 00:36:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.34463419s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.797728696s trace:
https://jaeger.dev.storj.io/trace/23afef2367e31b52
FAIL (2026-04-11 00:36:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.797744325s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
19.651392ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=QYGSxYfSfne Date=Sat, 11 Apr 2026 00:36:30 GMT Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18A52658AD3BA04A X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/8e79e71b4dac4a6
FAIL (2026-04-11 00:36:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A52658AD3BA04A</RequestId><HostId></HostId></Error>"
Duration: 19.776486ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
112.954899ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=5GngnJMVPCx Date=Sat, 11 Apr 2026 00:36:26 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18A52657D6E8807A X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/1a1bb29adf983404
FAIL (2026-04-11 00:36:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A52657D6E8807A</RequestId><HostId></HostId></Error>"
Duration: 112.972692ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
114.508027ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18A526543E3CAEE0 X-Request-Id=5eAaLG1TrRy Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:36:11 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1c127b4fe765c5d5
FAIL (2026-04-11 00:36:11 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A526543E3CAEE0</RequestId><HostId></HostId></Error>"
Duration: 114.527965ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
1.209486394s trace:
https://jaeger.dev.storj.io/trace/246b0cf010fe0949
FAIL (2026-04-11 00:36:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
26m58.524717394s) [noise=true , address=145.79.227.10:4404 , piece_id=VCYHMNYKDFFGRYJNHGJLT4YIBQPS6AHTJLI77Y4AR2RGIWLWF52A, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.386235481 (1252h26m58.525219685s) [noise=true , address=77.90.31.13:4626 , piece_id=MLPK7UBNLEO7OLG367ZD6DWMFTQNXAYZ5CE73L2HBX5BUDNNPVRA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.387577275 (1252h26m58.52656147s) [noise=true , address=145.79.227.52:4445 , piece_id=YNXTHR6G2VSWZORO4ZHZDRZO5KDQDPGPXAQ7CTZPRG7CH7PM24PQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.387788552 (1252h26m58.526772746s) [noise=true , address=145.79.227.51:4412 , piece_id=FU3QNM3JOCZSXA2YABOSSOZPXBWEKDVTZFSOYXTA52YG3GQ3PCYQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388213427 (1252h26m58.527197631s) [noise=true , address=77.90.31.14:4666 , piece_id=XEXKCHNUQQRMTBP3I5EXDDEVCTD47N5PXBTNHZUH44R75XMSEH3Q, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388240277 (1252h26m58.527224471s) [noise=true , address=145.79.227.9:4370 , piece_id=75WD2SGLBT3Y5OWO7GYIV64NOUKWZQZNIDXOV2MRRWOREOWM5KAQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388737148 (1252h26m58.527721343s) [noise=true , address=145.79.227.8:4335 , piece_id=WH3U7VO5KYL4POVCCXQU4L2AYNQ6TXL3F2ZT3N3XPVBFP4RZ6KKA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388783716 (1252h26m58.52776792s) [noise=true , address=145.79.227.19:4080 , piece_id=4EZ66JMT5KDVFLKFLLNPBON2AGJJ7V63IEJ3UC5ZCMHW72C6KT6A, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389095912 (1252h26m58.528080095s) [noise=true , address=145.79.227.11:4731 , piece_id=VDC3IRBVR34ROMWITOC7INZKFVPIY6P3SIJ4Y5T5UQDDIE2F5OIQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389226174 (1252h26m58.528210378s) [noise=true , address=145.79.227.39:4018 , piece_id=AHG5ROZ5MJNH2J4RALU647NFVND6RYSSQKOIN62IXJL7APNF3PLQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389631124 (1252h26m58.528615308s) [noise=true , address=145.79.227.42:4126 , piece_id=3SOIHC6OEKURVHGYN7HTBCT3JRZNF5WZ6H3KWSXDKL7LQDKWLHDQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389748964 (1252h26m58.528733169s) [noise=true , address=145.79.227.7:4296 , piece_id=AGLZROZVCWRJBGTJXJMW4Y7HURG3WB6OEZGNCCD2BHFNVUGQQ6UQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.390167329 (1252h26m58.529151513s) [noise=true , address=145.79.227.26:4658 , piece_id=PT5ZSW5VA6LSGWYET4PEP4OBAEQXSSYSWXKWPELWI5XYFGLOU3IA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.390548703 (1252h26m58.529532897s) [noise=true , address=145.79.227.25:4620 , piece_id=PQEN3BWUDSCGICRLUU4IKYHPTT7Q3CEZRYMOBMHORFYEV3B2N7XQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.458961811 (1252h26m58.597945986s) [upload=1101200]: Next returned nil segment
Apr 11 00:35:39.458969326 (1252h26m58.597953499s) [upload=1101200]: Waiting for error group managing segments...
Apr 11 00:35:39.469204574 (1252h26m58.608188757s) [noise=true , address=77.90.31.14:4666 , piece_id=XEXKCHNUQQRMTBP3I5EXDDEVCTD47N5PXBTNHZUH44R75XMSEH3Q, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:39.480291549 (1252h26m58.619275722s) [noise=true , address=77.90.31.13:4626 , piece_id=MLPK7UBNLEO7OLG367ZD6DWMFTQNXAYZ5CE73L2HBX5BUDNNPVRA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:39.488543230 (1252h26m58.627527414s) [noise=true , address=77.90.31.11:4556 , piece_id=MK5ODY7DGS6QYT4KMH3ZO2KQYMSULWSATZSTC2ZORTBSKPLZLDTA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:54.882618410 (1252h27m14.021602593s) [noise=true , address=145.79.227.52:4445 , piece_id=YNXTHR6G2VSWZORO4ZHZDRZO5KDQDPGPXAQ7CTZPRG7CH7PM24PQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo, address:145.79.227.52:4445): protocol: rpc: dial tcp 145.79.227.52:4445: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344483249 (1252h27m28.483467443s) [noise=true , address=145.79.227.19:4080 , piece_id=4EZ66JMT5KDVFLKFLLNPBON2AGJJ7V63IEJ3UC5ZCMHW72C6KT6A, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: rpc: dial tcp 145.79.227.19:4080: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344573928 (1252h27m28.483558122s) [noise=true , address=145.79.227.39:4018 , piece_id=AHG5ROZ5MJNH2J4RALU647NFVND6RYSSQKOIN62IXJL7APNF3PLQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12YcYgDWq2k7F9fwpdLAGNkrskGEUURe6QuRed7mRjMTdNHEQ8D, address:145.79.227.39:4018): protocol: rpc: dial tcp 145.79.227.39:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344717436 (1252h27m28.48370163s) [noise=true , address=145.79.227.42:4126 , piece_id=3SOIHC6OEKURVHGYN7HTBCT3JRZNF5WZ6H3KWSXDKL7LQDKWLHDQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344727846 (1252h27m28.48371204s) [noise=true , address=145.79.227.22:4510 , piece_id=PQM4DMJOIMVQXEDGXJBOEVW5ZUTVGRQHOXXOWTPHCZ7JJFHACNZQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9, address:145.79.227.22:4510): protocol: rpc: dial tcp 145.79.227.22:4510: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344829898 (1252h27m28.483814081s) [noise=true , address=145.79.227.11:4731 , piece_id=VDC3IRBVR34ROMWITOC7INZKFVPIY6P3SIJ4Y5T5UQDDIE2F5OIQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:145.79.227.11:4731): protocol: rpc: dial tcp 145.79.227.11:4731: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344875202 (1252h27m28.483859386s) [noise=true , address=145.79.227.7:4296 , piece_id=AGLZROZVCWRJBGTJXJMW4Y7HURG3WB6OEZGNCCD2BHFNVUGQQ6UQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1, address:145.79.227.7:4296): protocol: rpc: dial tcp 145.79.227.7:4296: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345017278 (1252h27m28.484001493s) [noise=true , address=145.79.227.9:4370 , piece_id=75WD2SGLBT3Y5OWO7GYIV64NOUKWZQZNIDXOV2MRRWOREOWM5KAQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12SXZN7WJvcHys9BRd4Lq8NAZ3MSgHf9ZVv7SgaiJNRosdmFVpm, address:145.79.227.9:4370): protocol: rpc: dial tcp 145.79.227.9:4370: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345050681 (1252h27m28.484034895s) [noise=true , address=145.79.227.51:4412 , piece_id=FU3QNM3JOCZSXA2YABOSSOZPXBWEKDVTZFSOYXTA52YG3GQ3PCYQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12vBvEfCYZxsv17cVsQTbCQ4YjZfiD4RXjWyz7Ka9ZZrtvzC7SS, address:145.79.227.51:4412): protocol: rpc: dial tcp 145.79.227.51:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345165256 (1252h27m28.48414944s) [noise=true , address=145.79.227.8:4335 , piece_id=WH3U7VO5KYL4POVCCXQU4L2AYNQ6TXL3F2ZT3N3XPVBFP4RZ6KKA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN, address:145.79.227.8:4335): protocol: rpc: dial tcp 145.79.227.8:4335: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345338371 (1252h27m28.484322554s) [noise=true , address=145.79.227.26:4658 , piece_id=PT5ZSW5VA6LSGWYET4PEP4OBAEQXSSYSWXKWPELWI5XYFGLOU3IA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1gcSHRechDzTDwivRoAwNFfNj5Zjqvi6oJwVqzbCQinwgWtpPr, address:145.79.227.26:4658): protocol: rpc: dial tcp 145.79.227.26:4658: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345505043 (1252h27m28.484489227s) [noise=true , address=145.79.227.10:4404 , piece_id=VCYHMNYKDFFGRYJNHGJLT4YIBQPS6AHTJLI77Y4AR2RGIWLWF52A, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: rpc: dial tcp 145.79.227.10:4404: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345654022 (1252h27m28.484638206s) [noise=true , address=145.79.227.25:4620 , piece_id=PQEN3BWUDSCGICRLUU4IKYHPTT7Q3CEZRYMOBMHORFYEV3B2N7XQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev, address:145.79.227.25:4620): protocol: rpc: dial tcp 145.79.227.25:4620: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345698466 (1252h27m28.48468265s) [seg_pos={0 0}, upload=1101200]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Apr 11 00:36:09.371563390 (1252h27m28.510547573s) [upload=1101200]: Done uploading segments...
Apr 11 00:36:09.371577836 (1252h27m28.510562021s) [upload=1101200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 1.209497495s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.028047614s trace:
https://jaeger.dev.storj.io/trace/246b0cf010fe0949
FAIL (2026-04-11 00:36:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 3)
======LOGS======
26m58.524717394s) [noise=true , address=145.79.227.10:4404 , piece_id=VCYHMNYKDFFGRYJNHGJLT4YIBQPS6AHTJLI77Y4AR2RGIWLWF52A, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.386235481 (1252h26m58.525219685s) [noise=true , address=77.90.31.13:4626 , piece_id=MLPK7UBNLEO7OLG367ZD6DWMFTQNXAYZ5CE73L2HBX5BUDNNPVRA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.387577275 (1252h26m58.52656147s) [noise=true , address=145.79.227.52:4445 , piece_id=YNXTHR6G2VSWZORO4ZHZDRZO5KDQDPGPXAQ7CTZPRG7CH7PM24PQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.387788552 (1252h26m58.526772746s) [noise=true , address=145.79.227.51:4412 , piece_id=FU3QNM3JOCZSXA2YABOSSOZPXBWEKDVTZFSOYXTA52YG3GQ3PCYQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388213427 (1252h26m58.527197631s) [noise=true , address=77.90.31.14:4666 , piece_id=XEXKCHNUQQRMTBP3I5EXDDEVCTD47N5PXBTNHZUH44R75XMSEH3Q, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388240277 (1252h26m58.527224471s) [noise=true , address=145.79.227.9:4370 , piece_id=75WD2SGLBT3Y5OWO7GYIV64NOUKWZQZNIDXOV2MRRWOREOWM5KAQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388737148 (1252h26m58.527721343s) [noise=true , address=145.79.227.8:4335 , piece_id=WH3U7VO5KYL4POVCCXQU4L2AYNQ6TXL3F2ZT3N3XPVBFP4RZ6KKA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.388783716 (1252h26m58.52776792s) [noise=true , address=145.79.227.19:4080 , piece_id=4EZ66JMT5KDVFLKFLLNPBON2AGJJ7V63IEJ3UC5ZCMHW72C6KT6A, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389095912 (1252h26m58.528080095s) [noise=true , address=145.79.227.11:4731 , piece_id=VDC3IRBVR34ROMWITOC7INZKFVPIY6P3SIJ4Y5T5UQDDIE2F5OIQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389226174 (1252h26m58.528210378s) [noise=true , address=145.79.227.39:4018 , piece_id=AHG5ROZ5MJNH2J4RALU647NFVND6RYSSQKOIN62IXJL7APNF3PLQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389631124 (1252h26m58.528615308s) [noise=true , address=145.79.227.42:4126 , piece_id=3SOIHC6OEKURVHGYN7HTBCT3JRZNF5WZ6H3KWSXDKL7LQDKWLHDQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.389748964 (1252h26m58.528733169s) [noise=true , address=145.79.227.7:4296 , piece_id=AGLZROZVCWRJBGTJXJMW4Y7HURG3WB6OEZGNCCD2BHFNVUGQQ6UQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.390167329 (1252h26m58.529151513s) [noise=true , address=145.79.227.26:4658 , piece_id=PT5ZSW5VA6LSGWYET4PEP4OBAEQXSSYSWXKWPELWI5XYFGLOU3IA, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.390548703 (1252h26m58.529532897s) [noise=true , address=145.79.227.25:4620 , piece_id=PQEN3BWUDSCGICRLUU4IKYHPTT7Q3CEZRYMOBMHORFYEV3B2N7XQ, seg_pos={0 0}, upload=1101200]: Uploading piece...
Apr 11 00:35:39.458961811 (1252h26m58.597945986s) [upload=1101200]: Next returned nil segment
Apr 11 00:35:39.458969326 (1252h26m58.597953499s) [upload=1101200]: Waiting for error group managing segments...
Apr 11 00:35:39.469204574 (1252h26m58.608188757s) [noise=true , address=77.90.31.14:4666 , piece_id=XEXKCHNUQQRMTBP3I5EXDDEVCTD47N5PXBTNHZUH44R75XMSEH3Q, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:39.480291549 (1252h26m58.619275722s) [noise=true , address=77.90.31.13:4626 , piece_id=MLPK7UBNLEO7OLG367ZD6DWMFTQNXAYZ5CE73L2HBX5BUDNNPVRA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:39.488543230 (1252h26m58.627527414s) [noise=true , address=77.90.31.11:4556 , piece_id=MK5ODY7DGS6QYT4KMH3ZO2KQYMSULWSATZSTC2ZORTBSKPLZLDTA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: <nil>
Apr 11 00:35:54.882618410 (1252h27m14.021602593s) [noise=true , address=145.79.227.52:4445 , piece_id=YNXTHR6G2VSWZORO4ZHZDRZO5KDQDPGPXAQ7CTZPRG7CH7PM24PQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo, address:145.79.227.52:4445): protocol: rpc: dial tcp 145.79.227.52:4445: connect: no route to host; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344483249 (1252h27m28.483467443s) [noise=true , address=145.79.227.19:4080 , piece_id=4EZ66JMT5KDVFLKFLLNPBON2AGJJ7V63IEJ3UC5ZCMHW72C6KT6A, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12KK51wudKiZb39Ku7wZhgBYEYmgsZTHfjiNNLmpBU9uuNFapt3, address:145.79.227.19:4080): protocol: rpc: dial tcp 145.79.227.19:4080: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344573928 (1252h27m28.483558122s) [noise=true , address=145.79.227.39:4018 , piece_id=AHG5ROZ5MJNH2J4RALU647NFVND6RYSSQKOIN62IXJL7APNF3PLQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12YcYgDWq2k7F9fwpdLAGNkrskGEUURe6QuRed7mRjMTdNHEQ8D, address:145.79.227.39:4018): protocol: rpc: dial tcp 145.79.227.39:4018: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344717436 (1252h27m28.48370163s) [noise=true , address=145.79.227.42:4126 , piece_id=3SOIHC6OEKURVHGYN7HTBCT3JRZNF5WZ6H3KWSXDKL7LQDKWLHDQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12dMWFrq2NMpnMzuPAphWerntC5kkrcnzRJZBA116uzJzyvk6fH, address:145.79.227.42:4126): protocol: rpc: dial tcp 145.79.227.42:4126: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344727846 (1252h27m28.48371204s) [noise=true , address=145.79.227.22:4510 , piece_id=PQM4DMJOIMVQXEDGXJBOEVW5ZUTVGRQHOXXOWTPHCZ7JJFHACNZQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12touQ91P4kPaTdodCZ2EfbbNE84Yto2kYSPhQ6UMZTR5mtH5r9, address:145.79.227.22:4510): protocol: rpc: dial tcp 145.79.227.22:4510: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344829898 (1252h27m28.483814081s) [noise=true , address=145.79.227.11:4731 , piece_id=VDC3IRBVR34ROMWITOC7INZKFVPIY6P3SIJ4Y5T5UQDDIE2F5OIQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:145.79.227.11:4731): protocol: rpc: dial tcp 145.79.227.11:4731: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.344875202 (1252h27m28.483859386s) [noise=true , address=145.79.227.7:4296 , piece_id=AGLZROZVCWRJBGTJXJMW4Y7HURG3WB6OEZGNCCD2BHFNVUGQQ6UQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1, address:145.79.227.7:4296): protocol: rpc: dial tcp 145.79.227.7:4296: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345017278 (1252h27m28.484001493s) [noise=true , address=145.79.227.9:4370 , piece_id=75WD2SGLBT3Y5OWO7GYIV64NOUKWZQZNIDXOV2MRRWOREOWM5KAQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12SXZN7WJvcHys9BRd4Lq8NAZ3MSgHf9ZVv7SgaiJNRosdmFVpm, address:145.79.227.9:4370): protocol: rpc: dial tcp 145.79.227.9:4370: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345050681 (1252h27m28.484034895s) [noise=true , address=145.79.227.51:4412 , piece_id=FU3QNM3JOCZSXA2YABOSSOZPXBWEKDVTZFSOYXTA52YG3GQ3PCYQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12vBvEfCYZxsv17cVsQTbCQ4YjZfiD4RXjWyz7Ka9ZZrtvzC7SS, address:145.79.227.51:4412): protocol: rpc: dial tcp 145.79.227.51:4412: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345165256 (1252h27m28.48414944s) [noise=true , address=145.79.227.8:4335 , piece_id=WH3U7VO5KYL4POVCCXQU4L2AYNQ6TXL3F2ZT3N3XPVBFP4RZ6KKA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1sKfG447ZZTQ6QJ1ohCxbfvm5Sv8u8azreBAqoC6EFbvXQdzwN, address:145.79.227.8:4335): protocol: rpc: dial tcp 145.79.227.8:4335: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345338371 (1252h27m28.484322554s) [noise=true , address=145.79.227.26:4658 , piece_id=PT5ZSW5VA6LSGWYET4PEP4OBAEQXSSYSWXKWPELWI5XYFGLOU3IA, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:1gcSHRechDzTDwivRoAwNFfNj5Zjqvi6oJwVqzbCQinwgWtpPr, address:145.79.227.26:4658): protocol: rpc: dial tcp 145.79.227.26:4658: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345505043 (1252h27m28.484489227s) [noise=true , address=145.79.227.10:4404 , piece_id=VCYHMNYKDFFGRYJNHGJLT4YIBQPS6AHTJLI77Y4AR2RGIWLWF52A, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b, address:145.79.227.10:4404): protocol: rpc: dial tcp 145.79.227.10:4404: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345654022 (1252h27m28.484638206s) [noise=true , address=145.79.227.25:4620 , piece_id=PQEN3BWUDSCGICRLUU4IKYHPTT7Q3CEZRYMOBMHORFYEV3B2N7XQ, seg_pos={0 0}, upload=1101200]: Done uploading piece. err: ecclient: upload failed (node:12QahNthBhqWBPgFFwAbsy5VrEuMxBkcuybmabY43sqBKKrW6ev, address:145.79.227.25:4620): protocol: rpc: dial tcp 145.79.227.25:4620: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:09.345698466 (1252h27m28.48468265s) [seg_pos={0 0}, upload=1101200]: Done waiting for segment. successful: 3 optimal: 13 errs: <nil>
Apr 11 00:36:09.371563390 (1252h27m28.510547573s) [upload=1101200]: Done uploading segments...
Apr 11 00:36:09.371577836 (1252h27m28.510562021s) [upload=1101200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 3)
Duration: 30.02805637s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
112.615252ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Length=274 Date=Sat, 11 Apr 2026 00:36:03 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18A526526995C1E2 X-Request-Id=RTorbvhdPGL target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/11e387a2daf7464f
FAIL (2026-04-11 00:36:03 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A526526995C1E2</RequestId><HostId></HostId></Error>"
Duration: 112.633345ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
36.230670518s trace:
https://jaeger.dev.storj.io/trace/23afef2367e31b52
FAIL (2026-04-11 00:36:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 36.230683502s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.313897065s trace:
https://jaeger.dev.storj.io/trace/763dfef2d18cd6e2
FAIL (2026-04-11 00:36:02 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
, upload=1101192]: Done begin upload segment.
Apr 11 00:35:00.354431566 (1252h26m19.49341576s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.355988042 (1252h26m19.494972236s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356468462 (1252h26m19.495452656s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356759707 (1252h26m19.495743891s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357047146 (1252h26m19.49603134s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357321861 (1252h26m19.496306055s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357587579 (1252h26m19.496571763s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357865299 (1252h26m19.496849493s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358122842 (1252h26m19.497107026s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358132610 (1252h26m19.497116794s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358406383 (1252h26m19.497390577s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358411694 (1252h26m19.497395877s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358709290 (1252h26m19.497693474s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359029180 (1252h26m19.498013364s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359423569 (1252h26m19.498407753s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359757234 (1252h26m19.498741418s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359839047 (1252h26m19.498823242s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.360180568 (1252h26m19.499164751s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.419188463 (1252h26m19.558172648s) [upload=1101192]: Next returned nil segment
Apr 11 00:35:00.419196418 (1252h26m19.558180602s) [upload=1101192]: Waiting for error group managing segments...
Apr 11 00:35:00.432316061 (1252h26m19.571300245s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.635711511 (1252h26m19.774695695s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.637901635 (1252h26m19.776885829s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.934800787 (1252h26m20.073784972s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.939956558 (1252h26m20.078940752s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.940039554 (1252h26m20.079023737s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941150174 (1252h26m20.080134359s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941411514 (1252h26m20.080395698s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941849996 (1252h26m20.08083418s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.960649371 (1252h26m20.099633565s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:01.307829827 (1252h26m20.446814012s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:36:00.327591793 (1252h27m19.466575967s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12bFi2opJ6FejAMwSL2qbqWoCk24QzSjT6xQYE8BytLgVJikZMT, address:145.79.227.19:4089): protocol: rpc: dial tcp 145.79.227.19:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327637769 (1252h27m19.466621964s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA, address:145.79.227.52:4461): protocol: rpc: dial tcp 145.79.227.52:4461: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327731975 (1252h27m19.46671616s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12aExoQdioFcK1qB46HjSQA6jany7ZxxgRYbBcBu75duXBEKWbi, address:145.79.227.13:4829): protocol: rpc: dial tcp 145.79.227.13:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327830250 (1252h27m19.466814424s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1JEqRG4b2YCdARm1eBnCgH4sAW4X7kRykNRZyTstpi8xavLqEg, address:145.79.227.32:4847): protocol: rpc: dial tcp 145.79.227.32:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327875465 (1252h27m19.466859659s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:145.79.227.40:4061): protocol: rpc: dial tcp 145.79.227.40:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328146733 (1252h27m19.467130927s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU, address:145.79.227.36:4542): protocol: rpc: dial tcp 145.79.227.36:4542: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328250037 (1252h27m19.467234211s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1dCvsMCm5ZRmWVqP1zr9noHVuPeyrXHjpRvdHnKoAZqqt6knx, address:145.79.227.29:4973): protocol: rpc: dial tcp 145.79.227.29:4973: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328267800 (1252h27m19.467251985s) [seg_pos={0 0}, upload=1101192]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:36:00.349355634 (1252h27m19.488339828s) [upload=1101192]: Done uploading segments...
Apr 11 00:36:00.349374158 (1252h27m19.488358352s) [upload=1101192]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 2.313907756s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.039572923s trace:
https://jaeger.dev.storj.io/trace/63c6acf9ae01bec7
FAIL (2026-04-11 00:36:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.039591818s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.023684458s trace:
https://jaeger.dev.storj.io/trace/763dfef2d18cd6e2
FAIL (2026-04-11 00:36:00 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
, upload=1101192]: Done begin upload segment.
Apr 11 00:35:00.354431566 (1252h26m19.49341576s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.355988042 (1252h26m19.494972236s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356468462 (1252h26m19.495452656s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.356759707 (1252h26m19.495743891s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357047146 (1252h26m19.49603134s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357321861 (1252h26m19.496306055s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357587579 (1252h26m19.496571763s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.357865299 (1252h26m19.496849493s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358122842 (1252h26m19.497107026s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358132610 (1252h26m19.497116794s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358406383 (1252h26m19.497390577s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358411694 (1252h26m19.497395877s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.358709290 (1252h26m19.497693474s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359029180 (1252h26m19.498013364s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359423569 (1252h26m19.498407753s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359757234 (1252h26m19.498741418s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.359839047 (1252h26m19.498823242s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.360180568 (1252h26m19.499164751s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Uploading piece...
Apr 11 00:35:00.419188463 (1252h26m19.558172648s) [upload=1101192]: Next returned nil segment
Apr 11 00:35:00.419196418 (1252h26m19.558180602s) [upload=1101192]: Waiting for error group managing segments...
Apr 11 00:35:00.432316061 (1252h26m19.571300245s) [noise=true , address=45.91.116.11:4135 , piece_id=OLKIKJFU2V7624ARI2VOEWWJX7ECEMPCJIWUWEBOQWYSJRHTLXDA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.635711511 (1252h26m19.774695695s) [noise=true , address=167.17.72.69:4710 , piece_id=AS6EL6TAR3JYIN5FNFFTNVWBNPFQ36Q6UULCZTOONU43QXUQKJMA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.637901635 (1252h26m19.776885829s) [noise=true , address=167.17.72.68:4669 , piece_id=TUI2SYKYEI4SVMG46LKN53ZRKCLB4AXKJNEMTVAWOU35TJZD2AKQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.934800787 (1252h26m20.073784972s) [noise=true , address=64.49.13.27:4967 , piece_id=TQRB662OLQAVXVXKB4X6U7PSPYQMUIMNEQLPKR2CXQGFZB7FSCWQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.939956558 (1252h26m20.078940752s) [noise=true , address=193.149.164.71:4298 , piece_id=NQ4TYVSF6AAV66PD7J55PP5LEIQEDCRHCY6PSMMI4RE52LNFJSPA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.940039554 (1252h26m20.079023737s) [noise=true , address=193.149.164.67:4997 , piece_id=7TRSFVVGUFVQIVXUEKC3RZMNMDZUHZFNNFAZIWVN25KN3TNVVGUQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941150174 (1252h26m20.080134359s) [noise=true , address=193.149.164.69:4071 , piece_id=IHOMNYUNJ57XQMN65I74JNYM7ILDRQ63N6BB7T7QAC2CGONXGPVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941411514 (1252h26m20.080395698s) [noise=true , address=193.149.164.66:4979 , piece_id=5WDHSGASPLS3BGJSWIZ5LCL24P67VTJTTWD273PIUC4QI4DHIYEA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.941849996 (1252h26m20.08083418s) [noise=true , address=193.149.164.70:4137 , piece_id=CO4C5KNHAOMMSX64NLCUJ5EV2GCFCEECB7DYRPBJLMW5ATNIEIVA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:00.960649371 (1252h26m20.099633565s) [noise=true , address=64.49.13.140:4507 , piece_id=XG5N7OU5GLI4P7SH5UKSJUVRVCUQB676275RUMKATBZJKJAZRKLQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:35:01.307829827 (1252h26m20.446814012s) [noise=true , address=77.90.31.17:4800 , piece_id=TW5YEGWX7COIVE3OR3G3U3XITBTEY5LAQQBQOZDXVWUSS2H4RKYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: <nil>
Apr 11 00:36:00.327591793 (1252h27m19.466575967s) [noise=true , address=145.79.227.19:4089 , piece_id=MOP6VLWI4PF3DHPRR34SWYETNKX6WYH4TD2EABDK5DF6MV6J5MWA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12bFi2opJ6FejAMwSL2qbqWoCk24QzSjT6xQYE8BytLgVJikZMT, address:145.79.227.19:4089): protocol: rpc: dial tcp 145.79.227.19:4089: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327637769 (1252h27m19.466621964s) [noise=true , address=145.79.227.52:4461 , piece_id=ZDDNKD3IHWX7LEXJHD6I4532MR4ICBMIE7S3IHHBIA7PRPD7DI3A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12fNrbSfErEQRnruJCJAVvkoNwQSPWnvNtxunHn6zrQegnNAkxA, address:145.79.227.52:4461): protocol: rpc: dial tcp 145.79.227.52:4461: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327731975 (1252h27m19.46671616s) [noise=true , address=145.79.227.13:4829 , piece_id=PVDRSVZQFPMNGVGNOKL3KD65CNP3F7QAK4CTTVEFFKOIEFKFJQ6A, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12aExoQdioFcK1qB46HjSQA6jany7ZxxgRYbBcBu75duXBEKWbi, address:145.79.227.13:4829): protocol: rpc: dial tcp 145.79.227.13:4829: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327830250 (1252h27m19.466814424s) [noise=true , address=145.79.227.32:4847 , piece_id=2BKKVHJNMBFEQWVCEADWLC4DZJB3G4ZYEW4R4THFY6J2PN6AGRSQ, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1JEqRG4b2YCdARm1eBnCgH4sAW4X7kRykNRZyTstpi8xavLqEg, address:145.79.227.32:4847): protocol: rpc: dial tcp 145.79.227.32:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.327875465 (1252h27m19.466859659s) [noise=true , address=145.79.227.40:4061 , piece_id=665BK63Z5EAMEX4KQL4QIEG2Y6UW4J7C2FIGAI2Z4C52NULVPRYA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:12KDgmvhgoRSTnByRrzSuw2N4iobi59Atdm2N2SsWZ4yoyfFHof, address:145.79.227.40:4061): protocol: rpc: dial tcp 145.79.227.40:4061: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328146733 (1252h27m19.467130927s) [noise=true , address=145.79.227.36:4542 , piece_id=B3ONGCMUTNCX3Z3S222GIZKV2ZI26L2DFVNVMX3CYCO6DGCN65GA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:129FwaCA1FbzJbmRNzhQeVgygicJYHWkSS9fLnJbAG7KZPpokLU, address:145.79.227.36:4542): protocol: rpc: dial tcp 145.79.227.36:4542: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328250037 (1252h27m19.467234211s) [noise=true , address=145.79.227.29:4973 , piece_id=2YQTFAU66N6WFOQMANYBTDJ5HPWJOOR3TUR6ABFP2JXC2AHA2IHA, seg_pos={0 0}, upload=1101192]: Done uploading piece. err: ecclient: upload failed (node:1dCvsMCm5ZRmWVqP1zr9noHVuPeyrXHjpRvdHnKoAZqqt6knx, address:145.79.227.29:4973): protocol: rpc: dial tcp 145.79.227.29:4973: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Apr 11 00:36:00.328267800 (1252h27m19.467251985s) [seg_pos={0 0}, upload=1101192]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Apr 11 00:36:00.349355634 (1252h27m19.488339828s) [upload=1101192]: Done uploading segments...
Apr 11 00:36:00.349374158 (1252h27m19.488358352s) [upload=1101192]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 1m0.023701119s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
112.873997ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18A526509C1FD54F X-Request-Id=Kz5cMPj3j9x Date=Sat, 11 Apr 2026 00:35:55 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4771c1ecdb2b88d
FAIL (2026-04-11 00:35:55 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A526509C1FD54F</RequestId><HostId></HostId></Error>"
Duration: 112.888864ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.888104ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=4s8k6jCyNwd Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18A5265043A3909D X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:35:54 GMT Accept-Ranges=bytes Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/564ccf2ff4d6fc49
FAIL (2026-04-11 00:35:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A5265043A3909D</RequestId><HostId></HostId></Error>"
Duration: 8.909052ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
1.198839607s trace:
https://jaeger.dev.storj.io/trace/75735e15af9b9b94
FAIL (2026-04-11 00:35:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.198854945s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
112.70056ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 X-Amz-Request-Id=18A5264C24C9640D Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=JoQvDLW3Vy3 X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:35:36 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/56d7b041ab1f2d33
FAIL (2026-04-11 00:35:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A5264C24C9640D</RequestId><HostId></HostId></Error>"
Duration: 112.715549ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000631101s trace:
https://jaeger.dev.storj.io/trace/63c6acf9ae01bec7
FAIL (2026-04-11 00:35:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.00064731s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.002331467s trace:
https://jaeger.dev.storj.io/trace/23afef2367e31b52
FAIL (2026-04-11 00:35:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.002346725s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
109.960988ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Server=Storj X-Amz-Request-Id=18A526496BBBA7CB X-Request-Id=HU3yZEpMYTT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:35:24 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/a73ecbd2b577b4d
FAIL (2026-04-11 00:35:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A526496BBBA7CB</RequestId><HostId></HostId></Error>"
Duration: 109.978762ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.170197ms remote:
"tcp:45.38.24.2:443" response headers:
Vary=Origin X-Amz-Request-Id=18A52647C4B08520 Content-Length=284 Content-Security-Policy=block-all-mixed-content X-Request-Id=31QzchLpbJM X-Xss-Protection=1; mode=block Date=Sat, 11 Apr 2026 00:35:17 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/452a4ee20fdff2dd
FAIL (2026-04-11 00:35:17 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A52647C4B08520</RequestId><HostId></HostId></Error>"
Duration: 13.190535ms
edge
gateway
vhost
us-select-1
|