Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
19.877084ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18A860B9363B5E07 X-Request-Id=KGGVBbvQphm Content-Length=284 Server=Storj X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 13:00:01 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3243ffc9a439ccd7
FAIL (2026-04-21 13:00:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860B9363B5E07</RequestId><HostId></HostId></Error>"
Duration: 19.921127ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
112.442946ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18A860B886848E9C X-Request-Id=hSnR5CwfBim Date=Tue, 21 Apr 2026 12:59:58 GMT Accept-Ranges=bytes Content-Length=274 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/691af30dbeb2b309
FAIL (2026-04-21 12:59:58 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860B886848E9C</RequestId><HostId></HostId></Error>"
Duration: 112.463946ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
111.143522ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18A860B5F95DA06A X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:59:47 GMT Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Request-Id=KTivsEdYqTm target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/60a93aaab53904c0
FAIL (2026-04-21 12:59:47 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860B5F95DA06A</RequestId><HostId></HostId></Error>"
Duration: 111.161215ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.751857307s trace:
https://jaeger.dev.storj.io/trace/4e9dae199ee76279
FAIL (2026-04-21 12:59:29 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 20)
======LOGS======
.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045691088 (1504h12m38.184675272s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045923434 (1504h12m38.184907628s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046178401 (1504h12m38.185162596s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046355473 (1504h12m38.185339667s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046683538 (1504h12m38.185667721s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.047495308 (1504h12m38.186479493s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048257497 (1504h12m38.187241681s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048854415 (1504h12m38.187838609s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.515264967 (1504h12m38.654249191s) [upload=1322699]: Next returned nil segment
Apr 21 12:21:19.515278342 (1504h12m38.654262556s) [upload=1322699]: Waiting for error group managing segments...
Apr 21 12:21:19.703406425 (1504h12m38.842390619s) [noise=true , address=185.167.204.205:4021 , piece_id=RKV3PUWQUIYSXSSRYFZ32J6AVGWCPZCPRY5Y2YNIK2NTVDC6CHRQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.730131039 (1504h12m38.869115233s) [noise=true , address=185.167.204.205:4019 , piece_id=DOMNJ7I4ZO45NTELTQX3QUU3JX4YN4UYHIHSA5ZRPOV5PYF75FRA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.731084987 (1504h12m38.870069181s) [noise=true , address=185.167.204.205:4004 , piece_id=PJC4PZAYGXJCK2FHHXX5BSKMVPV6FBYTXFFWC6CY2Q6PLIX2BNYQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.735652105 (1504h12m38.874636289s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737644859 (1504h12m38.876629053s) [noise=true , address=185.167.204.206:4050 , piece_id=HKWC5ASC356ATHAVCTJJ3TMI5K37WHD3ICRA4SZUWXH7QWGWTE5A, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737894997 (1504h12m38.876879191s) [noise=true , address=185.167.204.206:4055 , piece_id=RZYFRKQIXU7U3OYBNJ5Q64CCNHMCNUZEOAZPSAQPFN2X6H33K3MQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.764093146 (1504h12m38.90307734s) [noise=true , address=185.167.204.206:4058 , piece_id=EY73JSTDH74JXHBAZIINOGOXJ6RKCVGWUN7FBST6AVR5VFVQ3RWQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.768980523 (1504h12m38.907964717s) [noise=true , address=185.167.204.205:4031 , piece_id=MZTAVMGBLQCNOKSKUNM5Y3ZH4KUSWNH2B2KUDMO434EVDHDVGHIQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.773181955 (1504h12m38.912166149s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.776770759 (1504h12m38.915754953s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.798393967 (1504h12m38.937378161s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.011714033 (1504h12m39.150698227s) [noise=true , address=81.171.14.70:4046 , piece_id=6ZA6H3HO5TSVKGH7SX2R6LDV2AP3RDXOFVDHSL4T5GUUNYAOE3HA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.076555719 (1504h12m39.215539913s) [noise=true , address=81.171.14.70:4031 , piece_id=ZKR4TBGLZ5SQRBZMQMSKBLVSWHLKDPK4Q2XYNBU3SDIQKTAYKEFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.088338127 (1504h12m39.227322321s) [noise=true , address=81.171.14.70:4028 , piece_id=5QL4K447GG6MODYYMPT4VDOJMZP23MUWCKU56JEZ725G4AY2MRFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.107478730 (1504h12m39.246462934s) [noise=true , address=81.171.14.70:4038 , piece_id=U2CT6CZSBFCVTCY4FJI6HD3FIEOACWNYBVAMSIYT3KK7CKTCS34Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.114851585 (1504h12m39.253835769s) [noise=true , address=81.171.14.70:4035 , piece_id=FPDN74MXC3FU3JLVHF45342UEJ4WNDFHXYZIRJRVYL7EMKDF7IGQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.217835040 (1504h12m39.356819234s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.239449069 (1504h12m39.378433252s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.247447996 (1504h12m39.38643218s) [noise=true , address=185.167.204.205:4008 , piece_id=M7DDN4KHM52TUJGPZLYQCUGNXVYFJZVDU73NJTBVABXAWKIBEV2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.283865955 (1504h12m39.422850159s) [noise=true , address=185.167.204.205:4023 , piece_id=MJHIHUTD5WPNWLSMQMLRK6YYHLMMBZ5GFJKH446IYOX2YRKYC5UA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:22:18.638329368 (1504h13m37.777313583s) [noise=true , address=185.167.204.205:4024 , piece_id=E3QV54P7RULBJS7P2IN7L3U3WOTIPBJQBZ2GAFOZQNYTMY2TFXGA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638388760 (1504h13m37.777372974s) [noise=true , address=185.167.204.205:4028 , piece_id=QNJ62LOKBM2NVIAVIFQOP6HLCHMRBVEYDKWNIUWD72KGRCFZWJ6Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638481113 (1504h13m37.777465327s) [noise=true , address=185.167.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638516379 (1504h13m37.777500593s) [noise=true , address=89.149.201.147:4016 , piece_id=UJR5REGBDS3M6SXHO63SIKQJ32Q467ZDQXGYGM2F4YWAAUGBJO4Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638611738 (1504h13m37.777595962s) [noise=true , address=185.167.204.206:4064 , piece_id=ECORYVWLA6EPMUEBGXXMCVTI2AGBSBE6KP7YUENGMERNCXRML6LQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638782777 (1504h13m37.777766992s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639033387 (1504h13m37.778017601s) [noise=true , address=185.167.204.205:4003 , piece_id=ULMPKPYEGTVN2G333X4DCMQBGBDZF3PKADNFHBUIS3GWF5I6JRQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639189360 (1504h13m37.778173574s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639217953 (1504h13m37.778202168s) [seg_pos={0 0}, upload=1322699]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil>
Apr 21 12:22:18.760938266 (1504h13m37.89992248s) [upload=1322699]: Done uploading segments...
Apr 21 12:22:18.760973793 (1504h13m37.899958006s) [upload=1322699]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20)
Duration: 2.751874389s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.055275369s trace:
https://jaeger.dev.storj.io/trace/47ac3243934ef12e
FAIL (2026-04-21 12:59:26 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.055298973s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
4.571975835s trace:
https://jaeger.dev.storj.io/trace/7cc95b8fab0dd9cf
FAIL (2026-04-21 12:59:22 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.571996665s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
142.302295ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=NcmdcF111pS X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj Date=Tue, 21 Apr 2026 12:59:19 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18A860AF6C9F2E80 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6824e74edd74496c
FAIL (2026-04-21 12:59:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860AF6C9F2E80</RequestId><HostId></HostId></Error>"
Duration: 142.313246ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.937061ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj Date=Tue, 21 Apr 2026 12:59:10 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18A860AD34127C36 X-Request-Id=M4j5EaoRr5K X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/47f1e6f5c8254bd4
FAIL (2026-04-21 12:59:10 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860AD34127C36</RequestId><HostId></HostId></Error>"
Duration: 7.955125ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.175217ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Length=284 Server=Storj Vary=Origin X-Amz-Request-Id=18A860A934220C31 X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:58:52 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=GrEuisTSHUC target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/412d036cae8693a
FAIL (2026-04-21 12:58:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860A934220C31</RequestId><HostId></HostId></Error>"
Duration: 24.190366ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
110.62024ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Tue, 21 Apr 2026 12:58:50 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18A860A8B682DF49 X-Request-Id=3njR8Dx9xJ8 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4371314ece8194db
FAIL (2026-04-21 12:58:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860A8B682DF49</RequestId><HostId></HostId></Error>"
Duration: 110.638394ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
111.262405ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18A860A89F89D06B X-Request-Id=jT1sKgyAWF5 X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:58:50 GMT Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/6eec58ca5d0a477a
FAIL (2026-04-21 12:58:50 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860A89F89D06B</RequestId><HostId></HostId></Error>"
Duration: 111.27571ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.144008771s trace:
https://jaeger.dev.storj.io/trace/47ac3243934ef12e
FAIL (2026-04-21 12:58:41 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.144029038s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
110.926004ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=CccW5zznYMn Date=Tue, 21 Apr 2026 12:58:41 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=18A860A67495F334 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/7e112dbf39be17bb
FAIL (2026-04-21 12:58:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860A67495F334</RequestId><HostId></HostId></Error>"
Duration: 110.935001ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
4.394662764s trace:
https://jaeger.dev.storj.io/trace/7cc95b8fab0dd9cf
FAIL (2026-04-21 12:58:33 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.394684635s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
3.970060537s trace:
https://jaeger.dev.storj.io/trace/4e9dae199ee76279
FAIL (2026-04-21 12:58:23 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 20)
======LOGS======
.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045691088 (1504h12m38.184675272s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045923434 (1504h12m38.184907628s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046178401 (1504h12m38.185162596s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046355473 (1504h12m38.185339667s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046683538 (1504h12m38.185667721s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.047495308 (1504h12m38.186479493s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048257497 (1504h12m38.187241681s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048854415 (1504h12m38.187838609s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.515264967 (1504h12m38.654249191s) [upload=1322699]: Next returned nil segment
Apr 21 12:21:19.515278342 (1504h12m38.654262556s) [upload=1322699]: Waiting for error group managing segments...
Apr 21 12:21:19.703406425 (1504h12m38.842390619s) [noise=true , address=185.167.204.205:4021 , piece_id=RKV3PUWQUIYSXSSRYFZ32J6AVGWCPZCPRY5Y2YNIK2NTVDC6CHRQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.730131039 (1504h12m38.869115233s) [noise=true , address=185.167.204.205:4019 , piece_id=DOMNJ7I4ZO45NTELTQX3QUU3JX4YN4UYHIHSA5ZRPOV5PYF75FRA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.731084987 (1504h12m38.870069181s) [noise=true , address=185.167.204.205:4004 , piece_id=PJC4PZAYGXJCK2FHHXX5BSKMVPV6FBYTXFFWC6CY2Q6PLIX2BNYQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.735652105 (1504h12m38.874636289s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737644859 (1504h12m38.876629053s) [noise=true , address=185.167.204.206:4050 , piece_id=HKWC5ASC356ATHAVCTJJ3TMI5K37WHD3ICRA4SZUWXH7QWGWTE5A, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737894997 (1504h12m38.876879191s) [noise=true , address=185.167.204.206:4055 , piece_id=RZYFRKQIXU7U3OYBNJ5Q64CCNHMCNUZEOAZPSAQPFN2X6H33K3MQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.764093146 (1504h12m38.90307734s) [noise=true , address=185.167.204.206:4058 , piece_id=EY73JSTDH74JXHBAZIINOGOXJ6RKCVGWUN7FBST6AVR5VFVQ3RWQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.768980523 (1504h12m38.907964717s) [noise=true , address=185.167.204.205:4031 , piece_id=MZTAVMGBLQCNOKSKUNM5Y3ZH4KUSWNH2B2KUDMO434EVDHDVGHIQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.773181955 (1504h12m38.912166149s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.776770759 (1504h12m38.915754953s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.798393967 (1504h12m38.937378161s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.011714033 (1504h12m39.150698227s) [noise=true , address=81.171.14.70:4046 , piece_id=6ZA6H3HO5TSVKGH7SX2R6LDV2AP3RDXOFVDHSL4T5GUUNYAOE3HA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.076555719 (1504h12m39.215539913s) [noise=true , address=81.171.14.70:4031 , piece_id=ZKR4TBGLZ5SQRBZMQMSKBLVSWHLKDPK4Q2XYNBU3SDIQKTAYKEFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.088338127 (1504h12m39.227322321s) [noise=true , address=81.171.14.70:4028 , piece_id=5QL4K447GG6MODYYMPT4VDOJMZP23MUWCKU56JEZ725G4AY2MRFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.107478730 (1504h12m39.246462934s) [noise=true , address=81.171.14.70:4038 , piece_id=U2CT6CZSBFCVTCY4FJI6HD3FIEOACWNYBVAMSIYT3KK7CKTCS34Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.114851585 (1504h12m39.253835769s) [noise=true , address=81.171.14.70:4035 , piece_id=FPDN74MXC3FU3JLVHF45342UEJ4WNDFHXYZIRJRVYL7EMKDF7IGQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.217835040 (1504h12m39.356819234s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.239449069 (1504h12m39.378433252s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.247447996 (1504h12m39.38643218s) [noise=true , address=185.167.204.205:4008 , piece_id=M7DDN4KHM52TUJGPZLYQCUGNXVYFJZVDU73NJTBVABXAWKIBEV2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.283865955 (1504h12m39.422850159s) [noise=true , address=185.167.204.205:4023 , piece_id=MJHIHUTD5WPNWLSMQMLRK6YYHLMMBZ5GFJKH446IYOX2YRKYC5UA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:22:18.638329368 (1504h13m37.777313583s) [noise=true , address=185.167.204.205:4024 , piece_id=E3QV54P7RULBJS7P2IN7L3U3WOTIPBJQBZ2GAFOZQNYTMY2TFXGA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638388760 (1504h13m37.777372974s) [noise=true , address=185.167.204.205:4028 , piece_id=QNJ62LOKBM2NVIAVIFQOP6HLCHMRBVEYDKWNIUWD72KGRCFZWJ6Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638481113 (1504h13m37.777465327s) [noise=true , address=185.167.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638516379 (1504h13m37.777500593s) [noise=true , address=89.149.201.147:4016 , piece_id=UJR5REGBDS3M6SXHO63SIKQJ32Q467ZDQXGYGM2F4YWAAUGBJO4Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638611738 (1504h13m37.777595962s) [noise=true , address=185.167.204.206:4064 , piece_id=ECORYVWLA6EPMUEBGXXMCVTI2AGBSBE6KP7YUENGMERNCXRML6LQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638782777 (1504h13m37.777766992s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639033387 (1504h13m37.778017601s) [noise=true , address=185.167.204.205:4003 , piece_id=ULMPKPYEGTVN2G333X4DCMQBGBDZF3PKADNFHBUIS3GWF5I6JRQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639189360 (1504h13m37.778173574s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639217953 (1504h13m37.778202168s) [seg_pos={0 0}, upload=1322699]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil>
Apr 21 12:22:18.760938266 (1504h13m37.89992248s) [upload=1322699]: Done uploading segments...
Apr 21 12:22:18.760973793 (1504h13m37.899958006s) [upload=1322699]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20)
Duration: 3.970081166s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
111.133723ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18A860A22CDCCC06 X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:58:22 GMT Vary=Origin X-Request-Id=9pfd3kTaDoi Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/62970ff0efa0d69d
FAIL (2026-04-21 12:58:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860A22CDCCC06</RequestId><HostId></HostId></Error>"
Duration: 111.150134ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.135083698s trace:
https://jaeger.dev.storj.io/trace/47ac3243934ef12e
FAIL (2026-04-21 12:58:17 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.135112281s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
106.962537ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=18A8609F333A88E8 Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=iA1nnso8Vfw X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:58:09 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6e437f1c935b1cfd
FAIL (2026-04-21 12:58:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8609F333A88E8</RequestId><HostId></HostId></Error>"
Duration: 106.978768ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.328206337s trace:
https://jaeger.dev.storj.io/trace/4e9dae199ee76279
FAIL (2026-04-21 12:57:56 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 20)
======LOGS======
.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045691088 (1504h12m38.184675272s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045923434 (1504h12m38.184907628s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046178401 (1504h12m38.185162596s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046355473 (1504h12m38.185339667s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046683538 (1504h12m38.185667721s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.047495308 (1504h12m38.186479493s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048257497 (1504h12m38.187241681s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048854415 (1504h12m38.187838609s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.515264967 (1504h12m38.654249191s) [upload=1322699]: Next returned nil segment
Apr 21 12:21:19.515278342 (1504h12m38.654262556s) [upload=1322699]: Waiting for error group managing segments...
Apr 21 12:21:19.703406425 (1504h12m38.842390619s) [noise=true , address=185.167.204.205:4021 , piece_id=RKV3PUWQUIYSXSSRYFZ32J6AVGWCPZCPRY5Y2YNIK2NTVDC6CHRQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.730131039 (1504h12m38.869115233s) [noise=true , address=185.167.204.205:4019 , piece_id=DOMNJ7I4ZO45NTELTQX3QUU3JX4YN4UYHIHSA5ZRPOV5PYF75FRA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.731084987 (1504h12m38.870069181s) [noise=true , address=185.167.204.205:4004 , piece_id=PJC4PZAYGXJCK2FHHXX5BSKMVPV6FBYTXFFWC6CY2Q6PLIX2BNYQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.735652105 (1504h12m38.874636289s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737644859 (1504h12m38.876629053s) [noise=true , address=185.167.204.206:4050 , piece_id=HKWC5ASC356ATHAVCTJJ3TMI5K37WHD3ICRA4SZUWXH7QWGWTE5A, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737894997 (1504h12m38.876879191s) [noise=true , address=185.167.204.206:4055 , piece_id=RZYFRKQIXU7U3OYBNJ5Q64CCNHMCNUZEOAZPSAQPFN2X6H33K3MQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.764093146 (1504h12m38.90307734s) [noise=true , address=185.167.204.206:4058 , piece_id=EY73JSTDH74JXHBAZIINOGOXJ6RKCVGWUN7FBST6AVR5VFVQ3RWQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.768980523 (1504h12m38.907964717s) [noise=true , address=185.167.204.205:4031 , piece_id=MZTAVMGBLQCNOKSKUNM5Y3ZH4KUSWNH2B2KUDMO434EVDHDVGHIQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.773181955 (1504h12m38.912166149s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.776770759 (1504h12m38.915754953s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.798393967 (1504h12m38.937378161s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.011714033 (1504h12m39.150698227s) [noise=true , address=81.171.14.70:4046 , piece_id=6ZA6H3HO5TSVKGH7SX2R6LDV2AP3RDXOFVDHSL4T5GUUNYAOE3HA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.076555719 (1504h12m39.215539913s) [noise=true , address=81.171.14.70:4031 , piece_id=ZKR4TBGLZ5SQRBZMQMSKBLVSWHLKDPK4Q2XYNBU3SDIQKTAYKEFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.088338127 (1504h12m39.227322321s) [noise=true , address=81.171.14.70:4028 , piece_id=5QL4K447GG6MODYYMPT4VDOJMZP23MUWCKU56JEZ725G4AY2MRFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.107478730 (1504h12m39.246462934s) [noise=true , address=81.171.14.70:4038 , piece_id=U2CT6CZSBFCVTCY4FJI6HD3FIEOACWNYBVAMSIYT3KK7CKTCS34Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.114851585 (1504h12m39.253835769s) [noise=true , address=81.171.14.70:4035 , piece_id=FPDN74MXC3FU3JLVHF45342UEJ4WNDFHXYZIRJRVYL7EMKDF7IGQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.217835040 (1504h12m39.356819234s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.239449069 (1504h12m39.378433252s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.247447996 (1504h12m39.38643218s) [noise=true , address=185.167.204.205:4008 , piece_id=M7DDN4KHM52TUJGPZLYQCUGNXVYFJZVDU73NJTBVABXAWKIBEV2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.283865955 (1504h12m39.422850159s) [noise=true , address=185.167.204.205:4023 , piece_id=MJHIHUTD5WPNWLSMQMLRK6YYHLMMBZ5GFJKH446IYOX2YRKYC5UA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:22:18.638329368 (1504h13m37.777313583s) [noise=true , address=185.167.204.205:4024 , piece_id=E3QV54P7RULBJS7P2IN7L3U3WOTIPBJQBZ2GAFOZQNYTMY2TFXGA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638388760 (1504h13m37.777372974s) [noise=true , address=185.167.204.205:4028 , piece_id=QNJ62LOKBM2NVIAVIFQOP6HLCHMRBVEYDKWNIUWD72KGRCFZWJ6Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638481113 (1504h13m37.777465327s) [noise=true , address=185.167.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638516379 (1504h13m37.777500593s) [noise=true , address=89.149.201.147:4016 , piece_id=UJR5REGBDS3M6SXHO63SIKQJ32Q467ZDQXGYGM2F4YWAAUGBJO4Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638611738 (1504h13m37.777595962s) [noise=true , address=185.167.204.206:4064 , piece_id=ECORYVWLA6EPMUEBGXXMCVTI2AGBSBE6KP7YUENGMERNCXRML6LQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638782777 (1504h13m37.777766992s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639033387 (1504h13m37.778017601s) [noise=true , address=185.167.204.205:4003 , piece_id=ULMPKPYEGTVN2G333X4DCMQBGBDZF3PKADNFHBUIS3GWF5I6JRQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639189360 (1504h13m37.778173574s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639217953 (1504h13m37.778202168s) [seg_pos={0 0}, upload=1322699]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil>
Apr 21 12:22:18.760938266 (1504h13m37.89992248s) [upload=1322699]: Done uploading segments...
Apr 21 12:22:18.760973793 (1504h13m37.899958006s) [upload=1322699]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20)
Duration: 2.328225663s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.071020971s trace:
https://jaeger.dev.storj.io/trace/47ac3243934ef12e
FAIL (2026-04-21 12:57:52 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.071038844s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
106.190031ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:57:49 GMT Accept-Ranges=bytes X-Amz-Request-Id=18A8609A901834DC X-Request-Id=6D5NDs1rfz7 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/a31680480cf3ccb
FAIL (2026-04-21 12:57:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8609A901834DC</RequestId><HostId></HostId></Error>"
Duration: 106.206101ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
4.514170431s trace:
https://jaeger.dev.storj.io/trace/7cc95b8fab0dd9cf
FAIL (2026-04-21 12:57:44 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.514185729s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
6.248397ms remote:
"tcp:79.127.223.133:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18A86098682DCFB4 Date=Tue, 21 Apr 2026 12:57:40 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=aoPtdDyixQA X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/df595375bdbc0d
FAIL (2026-04-21 12:57:40 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A86098682DCFB4</RequestId><HostId></HostId></Error>"
Duration: 6.26527ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
4.63430192s trace:
https://jaeger.dev.storj.io/trace/7cc95b8fab0dd9cf
FAIL (2026-04-21 12:57:26 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.634336415s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
127.237288ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=7CmCoaCeeSJ X-Xss-Protection=1; mode=block Server=Storj Vary=Origin X-Amz-Request-Id=18A86094CD620893 Date=Tue, 21 Apr 2026 12:57:25 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1e89cd41cc814f90
FAIL (2026-04-21 12:57:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A86094CD620893</RequestId><HostId></HostId></Error>"
Duration: 127.25489ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
109.606964ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Request-Id=gC8CeXX7RN7 X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:57:19 GMT Content-Length=274 Server=Storj X-Amz-Request-Id=18A8609389F78583 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/330d9d60d78090a4
FAIL (2026-04-21 12:57:19 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8609389F78583</RequestId><HostId></HostId></Error>"
Duration: 109.625299ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.189849ms remote:
"tcp:79.127.223.133:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=18A86091D3CE6654 X-Request-Id=EJgWkA7gQFw Date=Tue, 21 Apr 2026 12:57:12 GMT Accept-Ranges=bytes X-Xss-Protection=1; mode=block Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3a012a205d72ba3
FAIL (2026-04-21 12:57:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A86091D3CE6654</RequestId><HostId></HostId></Error>"
Duration: 14.206069ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
110.237544ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content X-Request-Id=4azkQ5ZQaSN Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18A860918CD32B93 X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:57:11 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/37a1476a4a3568a0
FAIL (2026-04-21 12:57:11 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860918CD32B93</RequestId><HostId></HostId></Error>"
Duration: 110.254646ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.272311597s trace:
https://jaeger.dev.storj.io/trace/4e9dae199ee76279
FAIL (2026-04-21 12:57:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 20)
======LOGS======
.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045691088 (1504h12m38.184675272s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045923434 (1504h12m38.184907628s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046178401 (1504h12m38.185162596s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046355473 (1504h12m38.185339667s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046683538 (1504h12m38.185667721s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.047495308 (1504h12m38.186479493s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048257497 (1504h12m38.187241681s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048854415 (1504h12m38.187838609s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.515264967 (1504h12m38.654249191s) [upload=1322699]: Next returned nil segment
Apr 21 12:21:19.515278342 (1504h12m38.654262556s) [upload=1322699]: Waiting for error group managing segments...
Apr 21 12:21:19.703406425 (1504h12m38.842390619s) [noise=true , address=185.167.204.205:4021 , piece_id=RKV3PUWQUIYSXSSRYFZ32J6AVGWCPZCPRY5Y2YNIK2NTVDC6CHRQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.730131039 (1504h12m38.869115233s) [noise=true , address=185.167.204.205:4019 , piece_id=DOMNJ7I4ZO45NTELTQX3QUU3JX4YN4UYHIHSA5ZRPOV5PYF75FRA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.731084987 (1504h12m38.870069181s) [noise=true , address=185.167.204.205:4004 , piece_id=PJC4PZAYGXJCK2FHHXX5BSKMVPV6FBYTXFFWC6CY2Q6PLIX2BNYQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.735652105 (1504h12m38.874636289s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737644859 (1504h12m38.876629053s) [noise=true , address=185.167.204.206:4050 , piece_id=HKWC5ASC356ATHAVCTJJ3TMI5K37WHD3ICRA4SZUWXH7QWGWTE5A, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737894997 (1504h12m38.876879191s) [noise=true , address=185.167.204.206:4055 , piece_id=RZYFRKQIXU7U3OYBNJ5Q64CCNHMCNUZEOAZPSAQPFN2X6H33K3MQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.764093146 (1504h12m38.90307734s) [noise=true , address=185.167.204.206:4058 , piece_id=EY73JSTDH74JXHBAZIINOGOXJ6RKCVGWUN7FBST6AVR5VFVQ3RWQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.768980523 (1504h12m38.907964717s) [noise=true , address=185.167.204.205:4031 , piece_id=MZTAVMGBLQCNOKSKUNM5Y3ZH4KUSWNH2B2KUDMO434EVDHDVGHIQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.773181955 (1504h12m38.912166149s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.776770759 (1504h12m38.915754953s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.798393967 (1504h12m38.937378161s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.011714033 (1504h12m39.150698227s) [noise=true , address=81.171.14.70:4046 , piece_id=6ZA6H3HO5TSVKGH7SX2R6LDV2AP3RDXOFVDHSL4T5GUUNYAOE3HA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.076555719 (1504h12m39.215539913s) [noise=true , address=81.171.14.70:4031 , piece_id=ZKR4TBGLZ5SQRBZMQMSKBLVSWHLKDPK4Q2XYNBU3SDIQKTAYKEFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.088338127 (1504h12m39.227322321s) [noise=true , address=81.171.14.70:4028 , piece_id=5QL4K447GG6MODYYMPT4VDOJMZP23MUWCKU56JEZ725G4AY2MRFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.107478730 (1504h12m39.246462934s) [noise=true , address=81.171.14.70:4038 , piece_id=U2CT6CZSBFCVTCY4FJI6HD3FIEOACWNYBVAMSIYT3KK7CKTCS34Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.114851585 (1504h12m39.253835769s) [noise=true , address=81.171.14.70:4035 , piece_id=FPDN74MXC3FU3JLVHF45342UEJ4WNDFHXYZIRJRVYL7EMKDF7IGQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.217835040 (1504h12m39.356819234s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.239449069 (1504h12m39.378433252s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.247447996 (1504h12m39.38643218s) [noise=true , address=185.167.204.205:4008 , piece_id=M7DDN4KHM52TUJGPZLYQCUGNXVYFJZVDU73NJTBVABXAWKIBEV2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.283865955 (1504h12m39.422850159s) [noise=true , address=185.167.204.205:4023 , piece_id=MJHIHUTD5WPNWLSMQMLRK6YYHLMMBZ5GFJKH446IYOX2YRKYC5UA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:22:18.638329368 (1504h13m37.777313583s) [noise=true , address=185.167.204.205:4024 , piece_id=E3QV54P7RULBJS7P2IN7L3U3WOTIPBJQBZ2GAFOZQNYTMY2TFXGA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638388760 (1504h13m37.777372974s) [noise=true , address=185.167.204.205:4028 , piece_id=QNJ62LOKBM2NVIAVIFQOP6HLCHMRBVEYDKWNIUWD72KGRCFZWJ6Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638481113 (1504h13m37.777465327s) [noise=true , address=185.167.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638516379 (1504h13m37.777500593s) [noise=true , address=89.149.201.147:4016 , piece_id=UJR5REGBDS3M6SXHO63SIKQJ32Q467ZDQXGYGM2F4YWAAUGBJO4Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638611738 (1504h13m37.777595962s) [noise=true , address=185.167.204.206:4064 , piece_id=ECORYVWLA6EPMUEBGXXMCVTI2AGBSBE6KP7YUENGMERNCXRML6LQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638782777 (1504h13m37.777766992s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639033387 (1504h13m37.778017601s) [noise=true , address=185.167.204.205:4003 , piece_id=ULMPKPYEGTVN2G333X4DCMQBGBDZF3PKADNFHBUIS3GWF5I6JRQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639189360 (1504h13m37.778173574s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639217953 (1504h13m37.778202168s) [seg_pos={0 0}, upload=1322699]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil>
Apr 21 12:22:18.760938266 (1504h13m37.89992248s) [upload=1322699]: Done uploading segments...
Apr 21 12:22:18.760973793 (1504h13m37.899958006s) [upload=1322699]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20)
Duration: 2.272330342s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
109.528566ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Tue, 21 Apr 2026 12:57:01 GMT Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18A8608F6535C616 Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=PSLhHP8XafQ X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6c4312b524826dad
FAIL (2026-04-21 12:57:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8608F6535C616</RequestId><HostId></HostId></Error>"
Duration: 109.547762ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
111.479858ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:56:41 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18A8608AB42D10C6 Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=CV87QhnH4vw target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/361b35dcd78dc51
FAIL (2026-04-21 12:56:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8608AB42D10C6</RequestId><HostId></HostId></Error>"
Duration: 111.512741ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
107.269643ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Request-Id=i9pEc91Xk1M X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:56:41 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18A8608A86680491 Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/270d19801bc163ca
FAIL (2026-04-21 12:56:41 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8608A86680491</RequestId><HostId></HostId></Error>"
Duration: 107.289029ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.103025039s trace:
https://jaeger.dev.storj.io/trace/47ac3243934ef12e
FAIL (2026-04-21 12:56:38 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.103048112s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
123.496288ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=i8YzBNYLvhp X-Xss-Protection=1; mode=block Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=18A860897DFAFD01 Date=Tue, 21 Apr 2026 12:56:36 GMT Accept-Ranges=bytes Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/7b7ae66a174c283
FAIL (2026-04-21 12:56:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860897DFAFD01</RequestId><HostId></HostId></Error>"
Duration: 123.511116ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
4.78924819s trace:
https://jaeger.dev.storj.io/trace/7cc95b8fab0dd9cf
FAIL (2026-04-21 12:56:15 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.789275672s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.260482119s trace:
https://jaeger.dev.storj.io/trace/4e9dae199ee76279
FAIL (2026-04-21 12:56:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 20)
======LOGS======
.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045691088 (1504h12m38.184675272s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045923434 (1504h12m38.184907628s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046178401 (1504h12m38.185162596s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046355473 (1504h12m38.185339667s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046683538 (1504h12m38.185667721s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.047495308 (1504h12m38.186479493s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048257497 (1504h12m38.187241681s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048854415 (1504h12m38.187838609s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.515264967 (1504h12m38.654249191s) [upload=1322699]: Next returned nil segment
Apr 21 12:21:19.515278342 (1504h12m38.654262556s) [upload=1322699]: Waiting for error group managing segments...
Apr 21 12:21:19.703406425 (1504h12m38.842390619s) [noise=true , address=185.167.204.205:4021 , piece_id=RKV3PUWQUIYSXSSRYFZ32J6AVGWCPZCPRY5Y2YNIK2NTVDC6CHRQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.730131039 (1504h12m38.869115233s) [noise=true , address=185.167.204.205:4019 , piece_id=DOMNJ7I4ZO45NTELTQX3QUU3JX4YN4UYHIHSA5ZRPOV5PYF75FRA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.731084987 (1504h12m38.870069181s) [noise=true , address=185.167.204.205:4004 , piece_id=PJC4PZAYGXJCK2FHHXX5BSKMVPV6FBYTXFFWC6CY2Q6PLIX2BNYQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.735652105 (1504h12m38.874636289s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737644859 (1504h12m38.876629053s) [noise=true , address=185.167.204.206:4050 , piece_id=HKWC5ASC356ATHAVCTJJ3TMI5K37WHD3ICRA4SZUWXH7QWGWTE5A, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737894997 (1504h12m38.876879191s) [noise=true , address=185.167.204.206:4055 , piece_id=RZYFRKQIXU7U3OYBNJ5Q64CCNHMCNUZEOAZPSAQPFN2X6H33K3MQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.764093146 (1504h12m38.90307734s) [noise=true , address=185.167.204.206:4058 , piece_id=EY73JSTDH74JXHBAZIINOGOXJ6RKCVGWUN7FBST6AVR5VFVQ3RWQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.768980523 (1504h12m38.907964717s) [noise=true , address=185.167.204.205:4031 , piece_id=MZTAVMGBLQCNOKSKUNM5Y3ZH4KUSWNH2B2KUDMO434EVDHDVGHIQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.773181955 (1504h12m38.912166149s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.776770759 (1504h12m38.915754953s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.798393967 (1504h12m38.937378161s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.011714033 (1504h12m39.150698227s) [noise=true , address=81.171.14.70:4046 , piece_id=6ZA6H3HO5TSVKGH7SX2R6LDV2AP3RDXOFVDHSL4T5GUUNYAOE3HA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.076555719 (1504h12m39.215539913s) [noise=true , address=81.171.14.70:4031 , piece_id=ZKR4TBGLZ5SQRBZMQMSKBLVSWHLKDPK4Q2XYNBU3SDIQKTAYKEFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.088338127 (1504h12m39.227322321s) [noise=true , address=81.171.14.70:4028 , piece_id=5QL4K447GG6MODYYMPT4VDOJMZP23MUWCKU56JEZ725G4AY2MRFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.107478730 (1504h12m39.246462934s) [noise=true , address=81.171.14.70:4038 , piece_id=U2CT6CZSBFCVTCY4FJI6HD3FIEOACWNYBVAMSIYT3KK7CKTCS34Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.114851585 (1504h12m39.253835769s) [noise=true , address=81.171.14.70:4035 , piece_id=FPDN74MXC3FU3JLVHF45342UEJ4WNDFHXYZIRJRVYL7EMKDF7IGQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.217835040 (1504h12m39.356819234s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.239449069 (1504h12m39.378433252s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.247447996 (1504h12m39.38643218s) [noise=true , address=185.167.204.205:4008 , piece_id=M7DDN4KHM52TUJGPZLYQCUGNXVYFJZVDU73NJTBVABXAWKIBEV2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.283865955 (1504h12m39.422850159s) [noise=true , address=185.167.204.205:4023 , piece_id=MJHIHUTD5WPNWLSMQMLRK6YYHLMMBZ5GFJKH446IYOX2YRKYC5UA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:22:18.638329368 (1504h13m37.777313583s) [noise=true , address=185.167.204.205:4024 , piece_id=E3QV54P7RULBJS7P2IN7L3U3WOTIPBJQBZ2GAFOZQNYTMY2TFXGA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638388760 (1504h13m37.777372974s) [noise=true , address=185.167.204.205:4028 , piece_id=QNJ62LOKBM2NVIAVIFQOP6HLCHMRBVEYDKWNIUWD72KGRCFZWJ6Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638481113 (1504h13m37.777465327s) [noise=true , address=185.167.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638516379 (1504h13m37.777500593s) [noise=true , address=89.149.201.147:4016 , piece_id=UJR5REGBDS3M6SXHO63SIKQJ32Q467ZDQXGYGM2F4YWAAUGBJO4Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638611738 (1504h13m37.777595962s) [noise=true , address=185.167.204.206:4064 , piece_id=ECORYVWLA6EPMUEBGXXMCVTI2AGBSBE6KP7YUENGMERNCXRML6LQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638782777 (1504h13m37.777766992s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639033387 (1504h13m37.778017601s) [noise=true , address=185.167.204.205:4003 , piece_id=ULMPKPYEGTVN2G333X4DCMQBGBDZF3PKADNFHBUIS3GWF5I6JRQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639189360 (1504h13m37.778173574s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639217953 (1504h13m37.778202168s) [seg_pos={0 0}, upload=1322699]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil>
Apr 21 12:22:18.760938266 (1504h13m37.89992248s) [upload=1322699]: Done uploading segments...
Apr 21 12:22:18.760973793 (1504h13m37.899958006s) [upload=1322699]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20)
Duration: 2.260494551s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.425583ms remote:
"tcp:79.127.223.133:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin Accept-Ranges=bytes X-Amz-Request-Id=18A8608287259688 X-Request-Id=cYVRc9qyz13 X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:56:06 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/52ad797d02c6fae6
FAIL (2026-04-21 12:56:06 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8608287259688</RequestId><HostId></HostId></Error>"
Duration: 12.443034ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.064629135s trace:
https://jaeger.dev.storj.io/trace/47ac3243934ef12e
FAIL (2026-04-21 12:55:55 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.064645757s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
109.870847ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18A8607F93919E45 Date=Tue, 21 Apr 2026 12:55:54 GMT Server=Storj Vary=Origin X-Request-Id=HqhWtJbSaK8 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3b8b67825995b896
FAIL (2026-04-21 12:55:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8607F93919E45</RequestId><HostId></HostId></Error>"
Duration: 109.887448ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
107.572463ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=bwpqSs9ko1W X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:55:43 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18A8607D0E537663 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/74478fa03615caa7
FAIL (2026-04-21 12:55:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8607D0E537663</RequestId><HostId></HostId></Error>"
Duration: 107.589795ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
105.887196ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Server=Storj X-Request-Id=CYMPmh4Vr2W X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:55:33 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18A8607ACD555226 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/16afb7f28b90a963
FAIL (2026-04-21 12:55:33 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8607ACD555226</RequestId><HostId></HostId></Error>"
Duration: 105.90041ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.727118375s trace:
https://jaeger.dev.storj.io/trace/4e9dae199ee76279
FAIL (2026-04-21 12:55:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 20)
======LOGS======
.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045691088 (1504h12m38.184675272s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.045923434 (1504h12m38.184907628s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046178401 (1504h12m38.185162596s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046355473 (1504h12m38.185339667s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.046683538 (1504h12m38.185667721s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.047495308 (1504h12m38.186479493s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048257497 (1504h12m38.187241681s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.048854415 (1504h12m38.187838609s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Uploading piece...
Apr 21 12:21:19.515264967 (1504h12m38.654249191s) [upload=1322699]: Next returned nil segment
Apr 21 12:21:19.515278342 (1504h12m38.654262556s) [upload=1322699]: Waiting for error group managing segments...
Apr 21 12:21:19.703406425 (1504h12m38.842390619s) [noise=true , address=185.167.204.205:4021 , piece_id=RKV3PUWQUIYSXSSRYFZ32J6AVGWCPZCPRY5Y2YNIK2NTVDC6CHRQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.730131039 (1504h12m38.869115233s) [noise=true , address=185.167.204.205:4019 , piece_id=DOMNJ7I4ZO45NTELTQX3QUU3JX4YN4UYHIHSA5ZRPOV5PYF75FRA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.731084987 (1504h12m38.870069181s) [noise=true , address=185.167.204.205:4004 , piece_id=PJC4PZAYGXJCK2FHHXX5BSKMVPV6FBYTXFFWC6CY2Q6PLIX2BNYQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.735652105 (1504h12m38.874636289s) [noise=true , address=81.171.14.70:4041 , piece_id=LSJNGUOPHSKYWDY3FBUUXL3AKIHV765ANWNCAGRUAFKSDU3W3E7Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737644859 (1504h12m38.876629053s) [noise=true , address=185.167.204.206:4050 , piece_id=HKWC5ASC356ATHAVCTJJ3TMI5K37WHD3ICRA4SZUWXH7QWGWTE5A, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.737894997 (1504h12m38.876879191s) [noise=true , address=185.167.204.206:4055 , piece_id=RZYFRKQIXU7U3OYBNJ5Q64CCNHMCNUZEOAZPSAQPFN2X6H33K3MQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.764093146 (1504h12m38.90307734s) [noise=true , address=185.167.204.206:4058 , piece_id=EY73JSTDH74JXHBAZIINOGOXJ6RKCVGWUN7FBST6AVR5VFVQ3RWQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.768980523 (1504h12m38.907964717s) [noise=true , address=185.167.204.205:4031 , piece_id=MZTAVMGBLQCNOKSKUNM5Y3ZH4KUSWNH2B2KUDMO434EVDHDVGHIQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.773181955 (1504h12m38.912166149s) [noise=true , address=81.171.14.70:4036 , piece_id=OMJQ755WFNNLEXRQKBAO4RMH4KMZTA36TC73HLME22KGQI4AF5KA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.776770759 (1504h12m38.915754953s) [noise=true , address=81.171.14.70:4037 , piece_id=AW3SUCMXM3ZYGRPOREFWXKFQOXLZF42PO4RCQ4DOGXWBHWTR4Y2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:19.798393967 (1504h12m38.937378161s) [noise=true , address=89.149.201.147:4023 , piece_id=OEYEKHHC5SKA5NFW6JW4GELY5Q7MNUPCBD7RH2ZPJKG5PLXFLHQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.011714033 (1504h12m39.150698227s) [noise=true , address=81.171.14.70:4046 , piece_id=6ZA6H3HO5TSVKGH7SX2R6LDV2AP3RDXOFVDHSL4T5GUUNYAOE3HA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.076555719 (1504h12m39.215539913s) [noise=true , address=81.171.14.70:4031 , piece_id=ZKR4TBGLZ5SQRBZMQMSKBLVSWHLKDPK4Q2XYNBU3SDIQKTAYKEFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.088338127 (1504h12m39.227322321s) [noise=true , address=81.171.14.70:4028 , piece_id=5QL4K447GG6MODYYMPT4VDOJMZP23MUWCKU56JEZ725G4AY2MRFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.107478730 (1504h12m39.246462934s) [noise=true , address=81.171.14.70:4038 , piece_id=U2CT6CZSBFCVTCY4FJI6HD3FIEOACWNYBVAMSIYT3KK7CKTCS34Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.114851585 (1504h12m39.253835769s) [noise=true , address=81.171.14.70:4035 , piece_id=FPDN74MXC3FU3JLVHF45342UEJ4WNDFHXYZIRJRVYL7EMKDF7IGQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.217835040 (1504h12m39.356819234s) [noise=true , address=185.167.204.206:4053 , piece_id=FKZKC43TUX2FX4YJG2S5WX6WLBE32GBPMAYGGBHDAJR4CIEG6LLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.239449069 (1504h12m39.378433252s) [noise=true , address=81.171.14.70:4048 , piece_id=Z34T7HTKCD3KNFGSJ36OSPFAFD2SATH3WALDAWY6U42O7ZVV6NFQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.247447996 (1504h12m39.38643218s) [noise=true , address=185.167.204.205:4008 , piece_id=M7DDN4KHM52TUJGPZLYQCUGNXVYFJZVDU73NJTBVABXAWKIBEV2Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:21:20.283865955 (1504h12m39.422850159s) [noise=true , address=185.167.204.205:4023 , piece_id=MJHIHUTD5WPNWLSMQMLRK6YYHLMMBZ5GFJKH446IYOX2YRKYC5UA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: <nil>
Apr 21 12:22:18.638329368 (1504h13m37.777313583s) [noise=true , address=185.167.204.205:4024 , piece_id=E3QV54P7RULBJS7P2IN7L3U3WOTIPBJQBZ2GAFOZQNYTMY2TFXGA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638388760 (1504h13m37.777372974s) [noise=true , address=185.167.204.205:4028 , piece_id=QNJ62LOKBM2NVIAVIFQOP6HLCHMRBVEYDKWNIUWD72KGRCFZWJ6Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638481113 (1504h13m37.777465327s) [noise=true , address=185.167.204.206:4057 , piece_id=SHD3WOJHLQEEGRPYJEUNEZBJJNYVL2RHBUJRW3NAMMFTM7UZFIFA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1xy38NywWy5CSJ7CfupY78vbkHg6cQzgNhM2Z1xnpvw9dwvMoT, address:185.167.204.206:4057): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638516379 (1504h13m37.777500593s) [noise=true , address=89.149.201.147:4016 , piece_id=UJR5REGBDS3M6SXHO63SIKQJ32Q467ZDQXGYGM2F4YWAAUGBJO4Q, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12XsvrVhDGkU8BkYsBGmTtax47E43dZAYuGwD8WBMpp3n4GgDM5, address:89.149.201.147:4016): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638611738 (1504h13m37.777595962s) [noise=true , address=185.167.204.206:4064 , piece_id=ECORYVWLA6EPMUEBGXXMCVTI2AGBSBE6KP7YUENGMERNCXRML6LQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.638782777 (1504h13m37.777766992s) [noise=true , address=185.167.204.206:4043 , piece_id=US6A3FSJ4LVTRF64NP7CO6M5IQORYIADSRANKBSCPTWRNOEEDOJA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639033387 (1504h13m37.778017601s) [noise=true , address=185.167.204.205:4003 , piece_id=ULMPKPYEGTVN2G333X4DCMQBGBDZF3PKADNFHBUIS3GWF5I6JRQQ, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:1CjWvvJ4FdZc41sRgsQFWz4Y1ATZKgzsvDcUTmBSrCC15ekCmF, address:185.167.204.205:4003): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639189360 (1504h13m37.778173574s) [noise=true , address=185.167.204.206:4060 , piece_id=5S6W6QRRHPSXY47GP4J5WBCQWBHBN7F67257AQGQRVP4N4DBQPLA, seg_pos={0 0}, upload=1322699]: Done uploading piece. err: ecclient: upload failed (node:12RJC6wKVpcVGVNxVSXEYVXCVhC1vDPjbduZ1cFmCDPaYf1WTSr, address:185.167.204.206:4060): protocol: expected piece hash; context deadline exceeded; EOF
Apr 21 12:22:18.639217953 (1504h13m37.778202168s) [seg_pos={0 0}, upload=1322699]: Done waiting for segment. successful: 20 optimal: 26 errs: <nil>
Apr 21 12:22:18.760938266 (1504h13m37.89992248s) [upload=1322699]: Done uploading segments...
Apr 21 12:22:18.760973793 (1504h13m37.899958006s) [upload=1322699]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 20)
Duration: 2.72713698s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
105.940335ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18A86077FF637C89 X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=XNnhD8bc5Lx Date=Tue, 21 Apr 2026 12:55:21 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2df7026e8d3ed032
FAIL (2026-04-21 12:55:21 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A86077FF637C89</RequestId><HostId></HostId></Error>"
Duration: 105.957427ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
4.536893869s trace:
https://jaeger.dev.storj.io/trace/7cc95b8fab0dd9cf
FAIL (2026-04-21 12:55:19 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 4.536909188s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
6.482386ms remote:
"tcp:79.127.223.133:443" response headers:
Server=Storj Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=18A8607659B08593 X-Request-Id=fmZNgCrNTet X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:55:14 GMT Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3f8eae5d48d77360
FAIL (2026-04-21 12:55:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8607659B08593</RequestId><HostId></HostId></Error>"
Duration: 6.496002ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
113.310103ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=18A860765338FC46 X-Request-Id=SMNNFuTjWrM X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:55:14 GMT Content-Length=274 Server=Storj Vary=Origin Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/1aa00a6b01c1432a
FAIL (2026-04-21 12:55:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A860765338FC46</RequestId><HostId></HostId></Error>"
Duration: 113.327997ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
106.265564ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=9ynvvHthJpX X-Xss-Protection=1; mode=block Date=Tue, 21 Apr 2026 12:55:04 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=18A86073EEB042EF target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/63d9fabe93696561
FAIL (2026-04-21 12:55:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A86073EEB042EF</RequestId><HostId></HostId></Error>"
Duration: 106.297405ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.099227932s trace:
https://jaeger.dev.storj.io/trace/47ac3243934ef12e
FAIL (2026-04-21 12:54:54 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.099249461s
core
uplink
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
111.90428ms remote:
"tcp:136.0.77.3:443" response headers:
X-Request-Id=HGbfyPmLW2w Date=Tue, 21 Apr 2026 12:54:42 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=18A8606F001A06B6 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/230e517c0b001dc6
FAIL (2026-04-21 12:54:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8606F001A06B6</RequestId><HostId></HostId></Error>"
Duration: 111.927263ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
12.049999ms remote:
"tcp:79.127.223.133:443" response headers:
Server=Storj X-Request-Id=CDe9fFmkUAC X-Xss-Protection=1; mode=block Vary=Origin X-Amz-Request-Id=18A8606CADF060DE Date=Tue, 21 Apr 2026 12:54:32 GMT Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/68439a6d7a1bca20
FAIL (2026-04-21 12:54:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18A8606CADF060DE</RequestId><HostId></HostId></Error>"
Duration: 12.065809ms
edge
gateway
vhost
us-select-1
|