Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [X.X..X......................................................] duration:
2.284694228s trace:
https://jaeger.dev.storj.io/trace/18ca7b98681cce5a
FAIL (2026-02-26 10:42:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Feb 26 10:01:29.695649955 (205h52m48.834634168s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.695663810 (205h52m48.834648034s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696378264 (205h52m48.835362488s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696856468 (205h52m48.835840682s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697410122 (205h52m48.836394336s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697870322 (205h52m48.836854536s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698360618 (205h52m48.837344832s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698890107 (205h52m48.837874321s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700422690 (205h52m48.839406904s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700908807 (205h52m48.839893022s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:30.166437960 (205h52m49.305422164s) [upload=181027]: Next returned nil segment
Feb 26 10:01:30.166448219 (205h52m49.305432414s) [upload=181027]: Waiting for error group managing segments...
Feb 26 10:01:30.357388688 (205h52m49.496372902s) [noise=true , address=81.171.14.70:4037 , piece_id=IMJYVPFFFQTJ4NP6M4HDKLAGWECQIPQVFSRA5HSGXCHZYANPPTCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.361293382 (205h52m49.500277595s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.373763386 (205h52m49.5127476s) [noise=true , address=81.171.14.70:4032 , piece_id=7MAUJX2IV3EELPUCWXVPAESVX6YCRIKHUV6GBOFZHAXYEBSZ55JA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.381652062 (205h52m49.520636287s) [noise=true , address=185.167.204.206:4041 , piece_id=NDQZ6TJ4NJHXQAEOAZVTUUM5C5SIP2VXXHNXZ5NL5QUO3UR27KCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.386647563 (205h52m49.525631778s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.388750942 (205h52m49.527735167s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.389146813 (205h52m49.528131027s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.390513335 (205h52m49.52949756s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.392292178 (205h52m49.531276402s) [noise=true , address=81.171.14.70:4044 , piece_id=E5EMT7SH3SQRGILYTAZV4LZPKX5UPLTEFZFZMOJAYP6TOS7NBYEQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.397073840 (205h52m49.536058034s) [noise=true , address=185.167.204.205:4007 , piece_id=JLIPTELJREGJOQ3QFEAYFVK7LGPP76P6SWFTAO55UWSDCWVLAXPQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.398268522 (205h52m49.537252716s) [noise=true , address=185.167.204.205:4001 , piece_id=S7WH76K7S5YXIPITAOXZEMDLNSU37OVUPAJTSDLKDZXOWA4ZSK5Q, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.399416968 (205h52m49.538401152s) [noise=true , address=185.167.204.206:4056 , piece_id=7UF37JHCZ5G5EQEQ5GIC7PTV25C6EI6NT7M4FSKJ2OTPXY5JFEKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403130474 (205h52m49.542114668s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403591676 (205h52m49.542575859s) [noise=true , address=185.167.204.205:4032 , piece_id=NGBF5HYMNPYSPTVI2JL2SDKZKYBMCCJMZOHSZY7XCNDKZIHPWE3A, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414509660 (205h52m49.553493854s) [noise=true , address=185.167.204.205:4025 , piece_id=FRYYUJ4TAT2BZTJQZZB4JV7C5IJLZ4NWE6Y2YSKUIWSJPK4GLVDQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414697802 (205h52m49.553681986s) [noise=true , address=185.167.204.206:4053 , piece_id=HGASLIXZAUTS5EYUDJLUF7UUMF6XKJCBM4RNAWT5KZOMNTI5LEXA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422389459 (205h52m49.561373644s) [noise=true , address=89.149.201.147:4009 , piece_id=IZ4XME6VRUIK57TTTQT2US3WN4UCYKITLHX7YOHKWX64DZJ7YELA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422869808 (205h52m49.561853991s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.424793150 (205h52m49.563777344s) [noise=true , address=185.167.204.205:4004 , piece_id=GFWCT5MZWD4WLMQIGPR4LIZLTIKYTCYVFJYR2TDKLI5YX6MG7QBA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.425071389 (205h52m49.564055583s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.426571973 (205h52m49.565556158s) [noise=true , address=89.149.201.147:4017 , piece_id=HNRWXPXSFBI3VSHPB2EUHZENVX4FPBDA6QU6ACZL3WQQT42TRHAA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.429544084 (205h52m49.568528279s) [noise=true , address=89.149.201.147:4021 , piece_id=NAB3TW4PJP5OMM4JZRHTNMWFOSMJWHL6C6BKB32KZFYNVUIDPHSA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.441315013 (205h52m49.580299227s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.442787123 (205h52m49.581771338s) [noise=true , address=185.167.204.206:4054 , piece_id=LSHPBDWHD3BR4U34FDKFAYBX755JHU3JA35ELIAVCTHDOCHLRXPA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.443177042 (205h52m49.582161266s) [noise=true , address=185.167.204.206:4065 , piece_id=HHK34DOZ2S2RUS2L36TXAKPEFGVY5AXVFWSVVNRVIFC2SFC6H3ZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458482813 (205h52m49.597467027s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458495036 (205h52m49.59747925s) [seg_pos={0 0}, upload=181027]: Satisfied cohort requirements after 26 pieces
Feb 26 10:01:30.458652260 (205h52m49.597636473s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458661277 (205h52m49.59764549s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458784807 (205h52m49.597769021s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458792612 (205h52m49.597776826s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458810435 (205h52m49.597794649s) [seg_pos={0 0}, upload=181027]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 26 10:01:30.458876719 (205h52m49.597860932s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 26 10:01:30.458881848 (205h52m49.597866052s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 26 10:02:53.288204433 (205h54m12.427188617s) [upload=181027]: Done uploading segments...
Feb 26 10:02:53.288251401 (205h54m12.427235595s) [upload=181027]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.284713663s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.72546ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Vary=Origin Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1897C5E02B3E32E7 X-Request-Id=b9opECZdUSi X-Xss-Protection=1; mode=block Date=Thu, 26 Feb 2026 10:42:24 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/264fc626c804a3c9
FAIL (2026-02-26 10:42:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5E02B3E32E7</RequestId><HostId></HostId></Error>"
Duration: 23.741029ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.692299ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Request-Id=VC3BPa5AEbU Date=Thu, 26 Feb 2026 10:42:23 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897C5DFBAA9B970 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5c727e4239d8435d
FAIL (2026-02-26 10:42:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5DFBAA9B970</RequestId><HostId></HostId></Error>"
Duration: 23.708598ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.682922ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897C5DDF39E385A X-Request-Id=51PDj3eeLz9 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Server=Storj Date=Thu, 26 Feb 2026 10:42:15 GMT Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/5f4cc3df3a34b8f
FAIL (2026-02-26 10:42:15 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5DDF39E385A</RequestId><HostId></HostId></Error>"
Duration: 23.704041ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.X..X.X..X.................................................] duration:
928.816893ms trace:
https://jaeger.dev.storj.io/trace/34ba754b228106c3
FAIL (2026-02-26 10:42:11 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 928.846068ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
2 out of 60 is failed (threshold=3) [X.....X.....................................................] duration:
294.608726ms target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/103aca994b3c267e
FAIL (2026-02-26 10:42:10 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 294.635045ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
3.036745725s trace:
https://jaeger.dev.storj.io/trace/7fdafaffa97b0fec
FAIL (2026-02-26 10:42:09 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.036766192s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.847672ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml X-Amz-Request-Id=1897C5D862213A71 X-Xss-Protection=1; mode=block Date=Thu, 26 Feb 2026 10:41:51 GMT Server=Storj Vary=Origin X-Request-Id=YHaQo31pkTq Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/10e8deab54d81a1b
FAIL (2026-02-26 10:41:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5D862213A71</RequestId><HostId></HostId></Error>"
Duration: 11.863963ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.884962ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=1897C5D7A6DDBCD4 X-Request-Id=U98GUGgaJXs Date=Thu, 26 Feb 2026 10:41:48 GMT Accept-Ranges=bytes Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/67523bc5eeb135d4
FAIL (2026-02-26 10:41:48 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5D7A6DDBCD4</RequestId><HostId></HostId></Error>"
Duration: 26.902345ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.760191235s trace:
https://jaeger.dev.storj.io/trace/7fdafaffa97b0fec
FAIL (2026-02-26 10:41:44 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.760210732s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
3 out of 60 is failed (threshold=3) [XX.....X....................................................] duration:
294.372714ms target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/103aca994b3c267e
FAIL (2026-02-26 10:41:36 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 294.401728ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [.X.X..X.....................................................] duration:
2.67831053s trace:
https://jaeger.dev.storj.io/trace/18ca7b98681cce5a
FAIL (2026-02-26 10:41:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Feb 26 10:01:29.695649955 (205h52m48.834634168s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.695663810 (205h52m48.834648034s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696378264 (205h52m48.835362488s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696856468 (205h52m48.835840682s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697410122 (205h52m48.836394336s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697870322 (205h52m48.836854536s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698360618 (205h52m48.837344832s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698890107 (205h52m48.837874321s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700422690 (205h52m48.839406904s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700908807 (205h52m48.839893022s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:30.166437960 (205h52m49.305422164s) [upload=181027]: Next returned nil segment
Feb 26 10:01:30.166448219 (205h52m49.305432414s) [upload=181027]: Waiting for error group managing segments...
Feb 26 10:01:30.357388688 (205h52m49.496372902s) [noise=true , address=81.171.14.70:4037 , piece_id=IMJYVPFFFQTJ4NP6M4HDKLAGWECQIPQVFSRA5HSGXCHZYANPPTCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.361293382 (205h52m49.500277595s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.373763386 (205h52m49.5127476s) [noise=true , address=81.171.14.70:4032 , piece_id=7MAUJX2IV3EELPUCWXVPAESVX6YCRIKHUV6GBOFZHAXYEBSZ55JA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.381652062 (205h52m49.520636287s) [noise=true , address=185.167.204.206:4041 , piece_id=NDQZ6TJ4NJHXQAEOAZVTUUM5C5SIP2VXXHNXZ5NL5QUO3UR27KCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.386647563 (205h52m49.525631778s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.388750942 (205h52m49.527735167s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.389146813 (205h52m49.528131027s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.390513335 (205h52m49.52949756s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.392292178 (205h52m49.531276402s) [noise=true , address=81.171.14.70:4044 , piece_id=E5EMT7SH3SQRGILYTAZV4LZPKX5UPLTEFZFZMOJAYP6TOS7NBYEQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.397073840 (205h52m49.536058034s) [noise=true , address=185.167.204.205:4007 , piece_id=JLIPTELJREGJOQ3QFEAYFVK7LGPP76P6SWFTAO55UWSDCWVLAXPQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.398268522 (205h52m49.537252716s) [noise=true , address=185.167.204.205:4001 , piece_id=S7WH76K7S5YXIPITAOXZEMDLNSU37OVUPAJTSDLKDZXOWA4ZSK5Q, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.399416968 (205h52m49.538401152s) [noise=true , address=185.167.204.206:4056 , piece_id=7UF37JHCZ5G5EQEQ5GIC7PTV25C6EI6NT7M4FSKJ2OTPXY5JFEKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403130474 (205h52m49.542114668s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403591676 (205h52m49.542575859s) [noise=true , address=185.167.204.205:4032 , piece_id=NGBF5HYMNPYSPTVI2JL2SDKZKYBMCCJMZOHSZY7XCNDKZIHPWE3A, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414509660 (205h52m49.553493854s) [noise=true , address=185.167.204.205:4025 , piece_id=FRYYUJ4TAT2BZTJQZZB4JV7C5IJLZ4NWE6Y2YSKUIWSJPK4GLVDQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414697802 (205h52m49.553681986s) [noise=true , address=185.167.204.206:4053 , piece_id=HGASLIXZAUTS5EYUDJLUF7UUMF6XKJCBM4RNAWT5KZOMNTI5LEXA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422389459 (205h52m49.561373644s) [noise=true , address=89.149.201.147:4009 , piece_id=IZ4XME6VRUIK57TTTQT2US3WN4UCYKITLHX7YOHKWX64DZJ7YELA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422869808 (205h52m49.561853991s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.424793150 (205h52m49.563777344s) [noise=true , address=185.167.204.205:4004 , piece_id=GFWCT5MZWD4WLMQIGPR4LIZLTIKYTCYVFJYR2TDKLI5YX6MG7QBA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.425071389 (205h52m49.564055583s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.426571973 (205h52m49.565556158s) [noise=true , address=89.149.201.147:4017 , piece_id=HNRWXPXSFBI3VSHPB2EUHZENVX4FPBDA6QU6ACZL3WQQT42TRHAA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.429544084 (205h52m49.568528279s) [noise=true , address=89.149.201.147:4021 , piece_id=NAB3TW4PJP5OMM4JZRHTNMWFOSMJWHL6C6BKB32KZFYNVUIDPHSA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.441315013 (205h52m49.580299227s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.442787123 (205h52m49.581771338s) [noise=true , address=185.167.204.206:4054 , piece_id=LSHPBDWHD3BR4U34FDKFAYBX755JHU3JA35ELIAVCTHDOCHLRXPA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.443177042 (205h52m49.582161266s) [noise=true , address=185.167.204.206:4065 , piece_id=HHK34DOZ2S2RUS2L36TXAKPEFGVY5AXVFWSVVNRVIFC2SFC6H3ZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458482813 (205h52m49.597467027s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458495036 (205h52m49.59747925s) [seg_pos={0 0}, upload=181027]: Satisfied cohort requirements after 26 pieces
Feb 26 10:01:30.458652260 (205h52m49.597636473s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458661277 (205h52m49.59764549s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458784807 (205h52m49.597769021s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458792612 (205h52m49.597776826s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458810435 (205h52m49.597794649s) [seg_pos={0 0}, upload=181027]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 26 10:01:30.458876719 (205h52m49.597860932s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 26 10:01:30.458881848 (205h52m49.597866052s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 26 10:02:53.288204433 (205h54m12.427188617s) [upload=181027]: Done uploading segments...
Feb 26 10:02:53.288251401 (205h54m12.427235595s) [upload=181027]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.678329816s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.03635ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Date=Thu, 26 Feb 2026 10:41:20 GMT Server=Storj Vary=Origin X-Amz-Request-Id=1897C5D10DD00AA5 X-Request-Id=bG8bbR9zbGm X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/376691f77900771c
FAIL (2026-02-26 10:41:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5D10DD00AA5</RequestId><HostId></HostId></Error>"
Duration: 24.056658ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X.X..X.X..X................................................] duration:
906.376484ms trace:
https://jaeger.dev.storj.io/trace/34ba754b228106c3
FAIL (2026-02-26 10:41:11 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 906.441636ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.799839ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Date=Thu, 26 Feb 2026 10:41:09 GMT Vary=Origin X-Amz-Request-Id=1897C5CE7FD1E911 X-Request-Id=Mf89psVBarX X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2ad9cc7dd3ae5e47
FAIL (2026-02-26 10:41:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5CE7FD1E911</RequestId><HostId></HostId></Error>"
Duration: 23.823373ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.740239656s trace:
https://jaeger.dev.storj.io/trace/7fdafaffa97b0fec
FAIL (2026-02-26 10:41:01 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.74025231s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.822744ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=53uRjaYiJp5 Date=Thu, 26 Feb 2026 10:41:00 GMT Content-Length=274 Content-Type=application/xml X-Amz-Request-Id=1897C5CC7CC672F9 X-Xss-Protection=1; mode=block Accept-Ranges=bytes target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/457022ac1bf8f942
FAIL (2026-02-26 10:41:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5CC7CC672F9</RequestId><HostId></HostId></Error>"
Duration: 22.853221ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X.X..X.X..X...............................................] duration:
937.933102ms trace:
https://jaeger.dev.storj.io/trace/34ba754b228106c3
FAIL (2026-02-26 10:40:56 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 937.975462ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.048624ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Server=Storj X-Request-Id=4Up5fRvcuJV X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1897C5CB12A1CEA3 Date=Thu, 26 Feb 2026 10:40:54 GMT Accept-Ranges=bytes Content-Length=284 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/779fc740b10688eb
FAIL (2026-02-26 10:40:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5CB12A1CEA3</RequestId><HostId></HostId></Error>"
Duration: 8.066439ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
32.867839ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 X-Request-Id=TwzfokSkac2 X-Xss-Protection=1; mode=block Date=Thu, 26 Feb 2026 10:40:54 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1897C5CB15FD38A4 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/1c8e6b32f81cb921
FAIL (2026-02-26 10:40:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5CB15FD38A4</RequestId><HostId></HostId></Error>"
Duration: 32.881725ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [..X.X..X....................................................] duration:
2.263680843s trace:
https://jaeger.dev.storj.io/trace/18ca7b98681cce5a
FAIL (2026-02-26 10:40:53 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Feb 26 10:01:29.695649955 (205h52m48.834634168s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.695663810 (205h52m48.834648034s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696378264 (205h52m48.835362488s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696856468 (205h52m48.835840682s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697410122 (205h52m48.836394336s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697870322 (205h52m48.836854536s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698360618 (205h52m48.837344832s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698890107 (205h52m48.837874321s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700422690 (205h52m48.839406904s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700908807 (205h52m48.839893022s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:30.166437960 (205h52m49.305422164s) [upload=181027]: Next returned nil segment
Feb 26 10:01:30.166448219 (205h52m49.305432414s) [upload=181027]: Waiting for error group managing segments...
Feb 26 10:01:30.357388688 (205h52m49.496372902s) [noise=true , address=81.171.14.70:4037 , piece_id=IMJYVPFFFQTJ4NP6M4HDKLAGWECQIPQVFSRA5HSGXCHZYANPPTCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.361293382 (205h52m49.500277595s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.373763386 (205h52m49.5127476s) [noise=true , address=81.171.14.70:4032 , piece_id=7MAUJX2IV3EELPUCWXVPAESVX6YCRIKHUV6GBOFZHAXYEBSZ55JA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.381652062 (205h52m49.520636287s) [noise=true , address=185.167.204.206:4041 , piece_id=NDQZ6TJ4NJHXQAEOAZVTUUM5C5SIP2VXXHNXZ5NL5QUO3UR27KCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.386647563 (205h52m49.525631778s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.388750942 (205h52m49.527735167s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.389146813 (205h52m49.528131027s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.390513335 (205h52m49.52949756s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.392292178 (205h52m49.531276402s) [noise=true , address=81.171.14.70:4044 , piece_id=E5EMT7SH3SQRGILYTAZV4LZPKX5UPLTEFZFZMOJAYP6TOS7NBYEQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.397073840 (205h52m49.536058034s) [noise=true , address=185.167.204.205:4007 , piece_id=JLIPTELJREGJOQ3QFEAYFVK7LGPP76P6SWFTAO55UWSDCWVLAXPQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.398268522 (205h52m49.537252716s) [noise=true , address=185.167.204.205:4001 , piece_id=S7WH76K7S5YXIPITAOXZEMDLNSU37OVUPAJTSDLKDZXOWA4ZSK5Q, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.399416968 (205h52m49.538401152s) [noise=true , address=185.167.204.206:4056 , piece_id=7UF37JHCZ5G5EQEQ5GIC7PTV25C6EI6NT7M4FSKJ2OTPXY5JFEKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403130474 (205h52m49.542114668s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403591676 (205h52m49.542575859s) [noise=true , address=185.167.204.205:4032 , piece_id=NGBF5HYMNPYSPTVI2JL2SDKZKYBMCCJMZOHSZY7XCNDKZIHPWE3A, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414509660 (205h52m49.553493854s) [noise=true , address=185.167.204.205:4025 , piece_id=FRYYUJ4TAT2BZTJQZZB4JV7C5IJLZ4NWE6Y2YSKUIWSJPK4GLVDQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414697802 (205h52m49.553681986s) [noise=true , address=185.167.204.206:4053 , piece_id=HGASLIXZAUTS5EYUDJLUF7UUMF6XKJCBM4RNAWT5KZOMNTI5LEXA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422389459 (205h52m49.561373644s) [noise=true , address=89.149.201.147:4009 , piece_id=IZ4XME6VRUIK57TTTQT2US3WN4UCYKITLHX7YOHKWX64DZJ7YELA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422869808 (205h52m49.561853991s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.424793150 (205h52m49.563777344s) [noise=true , address=185.167.204.205:4004 , piece_id=GFWCT5MZWD4WLMQIGPR4LIZLTIKYTCYVFJYR2TDKLI5YX6MG7QBA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.425071389 (205h52m49.564055583s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.426571973 (205h52m49.565556158s) [noise=true , address=89.149.201.147:4017 , piece_id=HNRWXPXSFBI3VSHPB2EUHZENVX4FPBDA6QU6ACZL3WQQT42TRHAA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.429544084 (205h52m49.568528279s) [noise=true , address=89.149.201.147:4021 , piece_id=NAB3TW4PJP5OMM4JZRHTNMWFOSMJWHL6C6BKB32KZFYNVUIDPHSA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.441315013 (205h52m49.580299227s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.442787123 (205h52m49.581771338s) [noise=true , address=185.167.204.206:4054 , piece_id=LSHPBDWHD3BR4U34FDKFAYBX755JHU3JA35ELIAVCTHDOCHLRXPA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.443177042 (205h52m49.582161266s) [noise=true , address=185.167.204.206:4065 , piece_id=HHK34DOZ2S2RUS2L36TXAKPEFGVY5AXVFWSVVNRVIFC2SFC6H3ZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458482813 (205h52m49.597467027s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458495036 (205h52m49.59747925s) [seg_pos={0 0}, upload=181027]: Satisfied cohort requirements after 26 pieces
Feb 26 10:01:30.458652260 (205h52m49.597636473s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458661277 (205h52m49.59764549s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458784807 (205h52m49.597769021s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458792612 (205h52m49.597776826s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458810435 (205h52m49.597794649s) [seg_pos={0 0}, upload=181027]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 26 10:01:30.458876719 (205h52m49.597860932s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 26 10:01:30.458881848 (205h52m49.597866052s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 26 10:02:53.288204433 (205h54m12.427188617s) [upload=181027]: Done uploading segments...
Feb 26 10:02:53.288251401 (205h54m12.427235595s) [upload=181027]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.263705861s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
3 out of 60 is failed (threshold=3) [.XX.....X...................................................] duration:
310.172206ms target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/103aca994b3c267e
FAIL (2026-02-26 10:40:50 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 310.198474ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.511046ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Vary=Origin X-Request-Id=PSaNeRWEGZY Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1897C5C8A48F880B X-Xss-Protection=1; mode=block Date=Thu, 26 Feb 2026 10:40:43 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/26df0e920191571
FAIL (2026-02-26 10:40:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5C8A48F880B</RequestId><HostId></HostId></Error>"
Duration: 25.538899ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.240386ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897C5C5D252E076 X-Request-Id=cFpX9nbPa7f Date=Thu, 26 Feb 2026 10:40:31 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/571a12b9b6fd5feb
FAIL (2026-02-26 10:40:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5C5D252E076</RequestId><HostId></HostId></Error>"
Duration: 22.251557ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.439066ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1897C5C4F2435FAE X-Request-Id=aQsGxatGTRE Content-Security-Policy=block-all-mixed-content X-Xss-Protection=1; mode=block Date=Thu, 26 Feb 2026 10:40:28 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/211ea3ea6a96bd70
FAIL (2026-02-26 10:40:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5C4F2435FAE</RequestId><HostId></HostId></Error>"
Duration: 23.469353ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [...X.X..X...................................................] duration:
2.684523386s trace:
https://jaeger.dev.storj.io/trace/18ca7b98681cce5a
FAIL (2026-02-26 10:40:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Feb 26 10:01:29.695649955 (205h52m48.834634168s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.695663810 (205h52m48.834648034s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696378264 (205h52m48.835362488s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696856468 (205h52m48.835840682s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697410122 (205h52m48.836394336s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697870322 (205h52m48.836854536s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698360618 (205h52m48.837344832s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698890107 (205h52m48.837874321s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700422690 (205h52m48.839406904s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700908807 (205h52m48.839893022s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:30.166437960 (205h52m49.305422164s) [upload=181027]: Next returned nil segment
Feb 26 10:01:30.166448219 (205h52m49.305432414s) [upload=181027]: Waiting for error group managing segments...
Feb 26 10:01:30.357388688 (205h52m49.496372902s) [noise=true , address=81.171.14.70:4037 , piece_id=IMJYVPFFFQTJ4NP6M4HDKLAGWECQIPQVFSRA5HSGXCHZYANPPTCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.361293382 (205h52m49.500277595s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.373763386 (205h52m49.5127476s) [noise=true , address=81.171.14.70:4032 , piece_id=7MAUJX2IV3EELPUCWXVPAESVX6YCRIKHUV6GBOFZHAXYEBSZ55JA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.381652062 (205h52m49.520636287s) [noise=true , address=185.167.204.206:4041 , piece_id=NDQZ6TJ4NJHXQAEOAZVTUUM5C5SIP2VXXHNXZ5NL5QUO3UR27KCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.386647563 (205h52m49.525631778s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.388750942 (205h52m49.527735167s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.389146813 (205h52m49.528131027s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.390513335 (205h52m49.52949756s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.392292178 (205h52m49.531276402s) [noise=true , address=81.171.14.70:4044 , piece_id=E5EMT7SH3SQRGILYTAZV4LZPKX5UPLTEFZFZMOJAYP6TOS7NBYEQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.397073840 (205h52m49.536058034s) [noise=true , address=185.167.204.205:4007 , piece_id=JLIPTELJREGJOQ3QFEAYFVK7LGPP76P6SWFTAO55UWSDCWVLAXPQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.398268522 (205h52m49.537252716s) [noise=true , address=185.167.204.205:4001 , piece_id=S7WH76K7S5YXIPITAOXZEMDLNSU37OVUPAJTSDLKDZXOWA4ZSK5Q, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.399416968 (205h52m49.538401152s) [noise=true , address=185.167.204.206:4056 , piece_id=7UF37JHCZ5G5EQEQ5GIC7PTV25C6EI6NT7M4FSKJ2OTPXY5JFEKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403130474 (205h52m49.542114668s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403591676 (205h52m49.542575859s) [noise=true , address=185.167.204.205:4032 , piece_id=NGBF5HYMNPYSPTVI2JL2SDKZKYBMCCJMZOHSZY7XCNDKZIHPWE3A, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414509660 (205h52m49.553493854s) [noise=true , address=185.167.204.205:4025 , piece_id=FRYYUJ4TAT2BZTJQZZB4JV7C5IJLZ4NWE6Y2YSKUIWSJPK4GLVDQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414697802 (205h52m49.553681986s) [noise=true , address=185.167.204.206:4053 , piece_id=HGASLIXZAUTS5EYUDJLUF7UUMF6XKJCBM4RNAWT5KZOMNTI5LEXA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422389459 (205h52m49.561373644s) [noise=true , address=89.149.201.147:4009 , piece_id=IZ4XME6VRUIK57TTTQT2US3WN4UCYKITLHX7YOHKWX64DZJ7YELA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422869808 (205h52m49.561853991s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.424793150 (205h52m49.563777344s) [noise=true , address=185.167.204.205:4004 , piece_id=GFWCT5MZWD4WLMQIGPR4LIZLTIKYTCYVFJYR2TDKLI5YX6MG7QBA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.425071389 (205h52m49.564055583s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.426571973 (205h52m49.565556158s) [noise=true , address=89.149.201.147:4017 , piece_id=HNRWXPXSFBI3VSHPB2EUHZENVX4FPBDA6QU6ACZL3WQQT42TRHAA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.429544084 (205h52m49.568528279s) [noise=true , address=89.149.201.147:4021 , piece_id=NAB3TW4PJP5OMM4JZRHTNMWFOSMJWHL6C6BKB32KZFYNVUIDPHSA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.441315013 (205h52m49.580299227s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.442787123 (205h52m49.581771338s) [noise=true , address=185.167.204.206:4054 , piece_id=LSHPBDWHD3BR4U34FDKFAYBX755JHU3JA35ELIAVCTHDOCHLRXPA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.443177042 (205h52m49.582161266s) [noise=true , address=185.167.204.206:4065 , piece_id=HHK34DOZ2S2RUS2L36TXAKPEFGVY5AXVFWSVVNRVIFC2SFC6H3ZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458482813 (205h52m49.597467027s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458495036 (205h52m49.59747925s) [seg_pos={0 0}, upload=181027]: Satisfied cohort requirements after 26 pieces
Feb 26 10:01:30.458652260 (205h52m49.597636473s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458661277 (205h52m49.59764549s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458784807 (205h52m49.597769021s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458792612 (205h52m49.597776826s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458810435 (205h52m49.597794649s) [seg_pos={0 0}, upload=181027]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 26 10:01:30.458876719 (205h52m49.597860932s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 26 10:01:30.458881848 (205h52m49.597866052s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 26 10:02:53.288204433 (205h54m12.427188617s) [upload=181027]: Done uploading segments...
Feb 26 10:02:53.288251401 (205h54m12.427235595s) [upload=181027]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.68457924s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X.X..X.X..X..............................................] duration:
936.963664ms trace:
https://jaeger.dev.storj.io/trace/34ba754b228106c3
FAIL (2026-02-26 10:40:22 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 936.982469ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
3 out of 60 is failed (threshold=3) [..XX.....X..................................................] duration:
309.804991ms target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/103aca994b3c267e
FAIL (2026-02-26 10:40:20 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 309.825339ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
3.212918883s trace:
https://jaeger.dev.storj.io/trace/7fdafaffa97b0fec
FAIL (2026-02-26 10:40:18 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 3.212935895s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.752482ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897C5C1851DBC94 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj X-Request-Id=Tm2jtmuC4sn Date=Thu, 26 Feb 2026 10:40:13 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/15ab11e6320fda1b
FAIL (2026-02-26 10:40:13 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5C1851DBC94</RequestId><HostId></HostId></Error>"
Duration: 17.774573ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
3 out of 60 is failed (threshold=3) [...XX.....X.................................................] duration:
296.296445ms target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/103aca994b3c267e
FAIL (2026-02-26 10:40:04 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 296.314699ms
core
satellite
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
37.184264ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1897C5BF03B82A62 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=AEhbmbTskk2 Date=Thu, 26 Feb 2026 10:40:02 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/e8edb7200cf980a
FAIL (2026-02-26 10:40:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5BF03B82A62</RequestId><HostId></HostId></Error>"
Duration: 37.211375ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
3 out of 60 is failed (threshold=3) [....X.X..X..................................................] duration:
2.712937105s trace:
https://jaeger.dev.storj.io/trace/18ca7b98681cce5a
FAIL (2026-02-26 10:39:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Feb 26 10:01:29.695649955 (205h52m48.834634168s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.695663810 (205h52m48.834648034s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696378264 (205h52m48.835362488s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696856468 (205h52m48.835840682s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697410122 (205h52m48.836394336s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697870322 (205h52m48.836854536s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698360618 (205h52m48.837344832s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698890107 (205h52m48.837874321s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700422690 (205h52m48.839406904s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700908807 (205h52m48.839893022s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:30.166437960 (205h52m49.305422164s) [upload=181027]: Next returned nil segment
Feb 26 10:01:30.166448219 (205h52m49.305432414s) [upload=181027]: Waiting for error group managing segments...
Feb 26 10:01:30.357388688 (205h52m49.496372902s) [noise=true , address=81.171.14.70:4037 , piece_id=IMJYVPFFFQTJ4NP6M4HDKLAGWECQIPQVFSRA5HSGXCHZYANPPTCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.361293382 (205h52m49.500277595s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.373763386 (205h52m49.5127476s) [noise=true , address=81.171.14.70:4032 , piece_id=7MAUJX2IV3EELPUCWXVPAESVX6YCRIKHUV6GBOFZHAXYEBSZ55JA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.381652062 (205h52m49.520636287s) [noise=true , address=185.167.204.206:4041 , piece_id=NDQZ6TJ4NJHXQAEOAZVTUUM5C5SIP2VXXHNXZ5NL5QUO3UR27KCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.386647563 (205h52m49.525631778s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.388750942 (205h52m49.527735167s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.389146813 (205h52m49.528131027s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.390513335 (205h52m49.52949756s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.392292178 (205h52m49.531276402s) [noise=true , address=81.171.14.70:4044 , piece_id=E5EMT7SH3SQRGILYTAZV4LZPKX5UPLTEFZFZMOJAYP6TOS7NBYEQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.397073840 (205h52m49.536058034s) [noise=true , address=185.167.204.205:4007 , piece_id=JLIPTELJREGJOQ3QFEAYFVK7LGPP76P6SWFTAO55UWSDCWVLAXPQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.398268522 (205h52m49.537252716s) [noise=true , address=185.167.204.205:4001 , piece_id=S7WH76K7S5YXIPITAOXZEMDLNSU37OVUPAJTSDLKDZXOWA4ZSK5Q, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.399416968 (205h52m49.538401152s) [noise=true , address=185.167.204.206:4056 , piece_id=7UF37JHCZ5G5EQEQ5GIC7PTV25C6EI6NT7M4FSKJ2OTPXY5JFEKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403130474 (205h52m49.542114668s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403591676 (205h52m49.542575859s) [noise=true , address=185.167.204.205:4032 , piece_id=NGBF5HYMNPYSPTVI2JL2SDKZKYBMCCJMZOHSZY7XCNDKZIHPWE3A, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414509660 (205h52m49.553493854s) [noise=true , address=185.167.204.205:4025 , piece_id=FRYYUJ4TAT2BZTJQZZB4JV7C5IJLZ4NWE6Y2YSKUIWSJPK4GLVDQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414697802 (205h52m49.553681986s) [noise=true , address=185.167.204.206:4053 , piece_id=HGASLIXZAUTS5EYUDJLUF7UUMF6XKJCBM4RNAWT5KZOMNTI5LEXA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422389459 (205h52m49.561373644s) [noise=true , address=89.149.201.147:4009 , piece_id=IZ4XME6VRUIK57TTTQT2US3WN4UCYKITLHX7YOHKWX64DZJ7YELA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422869808 (205h52m49.561853991s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.424793150 (205h52m49.563777344s) [noise=true , address=185.167.204.205:4004 , piece_id=GFWCT5MZWD4WLMQIGPR4LIZLTIKYTCYVFJYR2TDKLI5YX6MG7QBA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.425071389 (205h52m49.564055583s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.426571973 (205h52m49.565556158s) [noise=true , address=89.149.201.147:4017 , piece_id=HNRWXPXSFBI3VSHPB2EUHZENVX4FPBDA6QU6ACZL3WQQT42TRHAA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.429544084 (205h52m49.568528279s) [noise=true , address=89.149.201.147:4021 , piece_id=NAB3TW4PJP5OMM4JZRHTNMWFOSMJWHL6C6BKB32KZFYNVUIDPHSA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.441315013 (205h52m49.580299227s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.442787123 (205h52m49.581771338s) [noise=true , address=185.167.204.206:4054 , piece_id=LSHPBDWHD3BR4U34FDKFAYBX755JHU3JA35ELIAVCTHDOCHLRXPA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.443177042 (205h52m49.582161266s) [noise=true , address=185.167.204.206:4065 , piece_id=HHK34DOZ2S2RUS2L36TXAKPEFGVY5AXVFWSVVNRVIFC2SFC6H3ZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458482813 (205h52m49.597467027s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458495036 (205h52m49.59747925s) [seg_pos={0 0}, upload=181027]: Satisfied cohort requirements after 26 pieces
Feb 26 10:01:30.458652260 (205h52m49.597636473s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458661277 (205h52m49.59764549s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458784807 (205h52m49.597769021s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458792612 (205h52m49.597776826s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458810435 (205h52m49.597794649s) [seg_pos={0 0}, upload=181027]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 26 10:01:30.458876719 (205h52m49.597860932s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 26 10:01:30.458881848 (205h52m49.597866052s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 26 10:02:53.288204433 (205h54m12.427188617s) [upload=181027]: Done uploading segments...
Feb 26 10:02:53.288251401 (205h54m12.427235595s) [upload=181027]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.712959999s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
27.830458ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1897C5BCF64A3DD2 Date=Thu, 26 Feb 2026 10:39:53 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Request-Id=QpcrVcPAvH9 X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/52a82fdf9c8a98c0
FAIL (2026-02-26 10:39:53 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5BCF64A3DD2</RequestId><HostId></HostId></Error>"
Duration: 27.869151ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [X....X.X..X.................................................] duration:
2.762223823s trace:
https://jaeger.dev.storj.io/trace/18ca7b98681cce5a
FAIL (2026-02-26 10:39:28 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Feb 26 10:01:29.695649955 (205h52m48.834634168s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.695663810 (205h52m48.834648034s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696378264 (205h52m48.835362488s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696856468 (205h52m48.835840682s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697410122 (205h52m48.836394336s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697870322 (205h52m48.836854536s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698360618 (205h52m48.837344832s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698890107 (205h52m48.837874321s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700422690 (205h52m48.839406904s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700908807 (205h52m48.839893022s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:30.166437960 (205h52m49.305422164s) [upload=181027]: Next returned nil segment
Feb 26 10:01:30.166448219 (205h52m49.305432414s) [upload=181027]: Waiting for error group managing segments...
Feb 26 10:01:30.357388688 (205h52m49.496372902s) [noise=true , address=81.171.14.70:4037 , piece_id=IMJYVPFFFQTJ4NP6M4HDKLAGWECQIPQVFSRA5HSGXCHZYANPPTCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.361293382 (205h52m49.500277595s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.373763386 (205h52m49.5127476s) [noise=true , address=81.171.14.70:4032 , piece_id=7MAUJX2IV3EELPUCWXVPAESVX6YCRIKHUV6GBOFZHAXYEBSZ55JA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.381652062 (205h52m49.520636287s) [noise=true , address=185.167.204.206:4041 , piece_id=NDQZ6TJ4NJHXQAEOAZVTUUM5C5SIP2VXXHNXZ5NL5QUO3UR27KCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.386647563 (205h52m49.525631778s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.388750942 (205h52m49.527735167s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.389146813 (205h52m49.528131027s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.390513335 (205h52m49.52949756s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.392292178 (205h52m49.531276402s) [noise=true , address=81.171.14.70:4044 , piece_id=E5EMT7SH3SQRGILYTAZV4LZPKX5UPLTEFZFZMOJAYP6TOS7NBYEQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.397073840 (205h52m49.536058034s) [noise=true , address=185.167.204.205:4007 , piece_id=JLIPTELJREGJOQ3QFEAYFVK7LGPP76P6SWFTAO55UWSDCWVLAXPQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.398268522 (205h52m49.537252716s) [noise=true , address=185.167.204.205:4001 , piece_id=S7WH76K7S5YXIPITAOXZEMDLNSU37OVUPAJTSDLKDZXOWA4ZSK5Q, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.399416968 (205h52m49.538401152s) [noise=true , address=185.167.204.206:4056 , piece_id=7UF37JHCZ5G5EQEQ5GIC7PTV25C6EI6NT7M4FSKJ2OTPXY5JFEKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403130474 (205h52m49.542114668s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403591676 (205h52m49.542575859s) [noise=true , address=185.167.204.205:4032 , piece_id=NGBF5HYMNPYSPTVI2JL2SDKZKYBMCCJMZOHSZY7XCNDKZIHPWE3A, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414509660 (205h52m49.553493854s) [noise=true , address=185.167.204.205:4025 , piece_id=FRYYUJ4TAT2BZTJQZZB4JV7C5IJLZ4NWE6Y2YSKUIWSJPK4GLVDQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414697802 (205h52m49.553681986s) [noise=true , address=185.167.204.206:4053 , piece_id=HGASLIXZAUTS5EYUDJLUF7UUMF6XKJCBM4RNAWT5KZOMNTI5LEXA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422389459 (205h52m49.561373644s) [noise=true , address=89.149.201.147:4009 , piece_id=IZ4XME6VRUIK57TTTQT2US3WN4UCYKITLHX7YOHKWX64DZJ7YELA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422869808 (205h52m49.561853991s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.424793150 (205h52m49.563777344s) [noise=true , address=185.167.204.205:4004 , piece_id=GFWCT5MZWD4WLMQIGPR4LIZLTIKYTCYVFJYR2TDKLI5YX6MG7QBA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.425071389 (205h52m49.564055583s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.426571973 (205h52m49.565556158s) [noise=true , address=89.149.201.147:4017 , piece_id=HNRWXPXSFBI3VSHPB2EUHZENVX4FPBDA6QU6ACZL3WQQT42TRHAA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.429544084 (205h52m49.568528279s) [noise=true , address=89.149.201.147:4021 , piece_id=NAB3TW4PJP5OMM4JZRHTNMWFOSMJWHL6C6BKB32KZFYNVUIDPHSA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.441315013 (205h52m49.580299227s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.442787123 (205h52m49.581771338s) [noise=true , address=185.167.204.206:4054 , piece_id=LSHPBDWHD3BR4U34FDKFAYBX755JHU3JA35ELIAVCTHDOCHLRXPA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.443177042 (205h52m49.582161266s) [noise=true , address=185.167.204.206:4065 , piece_id=HHK34DOZ2S2RUS2L36TXAKPEFGVY5AXVFWSVVNRVIFC2SFC6H3ZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458482813 (205h52m49.597467027s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458495036 (205h52m49.59747925s) [seg_pos={0 0}, upload=181027]: Satisfied cohort requirements after 26 pieces
Feb 26 10:01:30.458652260 (205h52m49.597636473s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458661277 (205h52m49.59764549s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458784807 (205h52m49.597769021s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458792612 (205h52m49.597776826s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458810435 (205h52m49.597794649s) [seg_pos={0 0}, upload=181027]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 26 10:01:30.458876719 (205h52m49.597860932s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 26 10:01:30.458881848 (205h52m49.597866052s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 26 10:02:53.288204433 (205h54m12.427188617s) [upload=181027]: Done uploading segments...
Feb 26 10:02:53.288251401 (205h54m12.427235595s) [upload=181027]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.762250614s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.222675ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1897C5B6B5470BBB X-Request-Id=ixasfjLg5BN X-Xss-Protection=1; mode=block Content-Type=application/xml Server=Storj Date=Thu, 26 Feb 2026 10:39:26 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2e31789c92ab7870
FAIL (2026-02-26 10:39:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5B6B5470BBB</RequestId><HostId></HostId></Error>"
Duration: 26.24122ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
3 out of 60 is failed (threshold=3) [....XX.....X................................................] duration:
295.705201ms target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/103aca994b3c267e
FAIL (2026-02-26 10:39:24 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 295.727082ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.930840789s trace:
https://jaeger.dev.storj.io/trace/7fdafaffa97b0fec
FAIL (2026-02-26 10:39:20 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.930862269s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X.X..X.X..X.............................................] duration:
918.934083ms trace:
https://jaeger.dev.storj.io/trace/34ba754b228106c3
FAIL (2026-02-26 10:39:16 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 918.955092ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
33.96631ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj X-Amz-Request-Id=1897C5B45124D100 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=5vM9bBh2A4i X-Xss-Protection=1; mode=block Date=Thu, 26 Feb 2026 10:39:16 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/574d6dc45505d6ae
FAIL (2026-02-26 10:39:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5B45124D100</RequestId><HostId></HostId></Error>"
Duration: 33.988662ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [.X....X.X..X................................................] duration:
2.293005083s trace:
https://jaeger.dev.storj.io/trace/18ca7b98681cce5a
FAIL (2026-02-26 10:39:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Feb 26 10:01:29.695649955 (205h52m48.834634168s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.695663810 (205h52m48.834648034s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696378264 (205h52m48.835362488s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696856468 (205h52m48.835840682s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697410122 (205h52m48.836394336s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697870322 (205h52m48.836854536s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698360618 (205h52m48.837344832s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698890107 (205h52m48.837874321s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700422690 (205h52m48.839406904s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700908807 (205h52m48.839893022s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:30.166437960 (205h52m49.305422164s) [upload=181027]: Next returned nil segment
Feb 26 10:01:30.166448219 (205h52m49.305432414s) [upload=181027]: Waiting for error group managing segments...
Feb 26 10:01:30.357388688 (205h52m49.496372902s) [noise=true , address=81.171.14.70:4037 , piece_id=IMJYVPFFFQTJ4NP6M4HDKLAGWECQIPQVFSRA5HSGXCHZYANPPTCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.361293382 (205h52m49.500277595s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.373763386 (205h52m49.5127476s) [noise=true , address=81.171.14.70:4032 , piece_id=7MAUJX2IV3EELPUCWXVPAESVX6YCRIKHUV6GBOFZHAXYEBSZ55JA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.381652062 (205h52m49.520636287s) [noise=true , address=185.167.204.206:4041 , piece_id=NDQZ6TJ4NJHXQAEOAZVTUUM5C5SIP2VXXHNXZ5NL5QUO3UR27KCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.386647563 (205h52m49.525631778s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.388750942 (205h52m49.527735167s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.389146813 (205h52m49.528131027s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.390513335 (205h52m49.52949756s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.392292178 (205h52m49.531276402s) [noise=true , address=81.171.14.70:4044 , piece_id=E5EMT7SH3SQRGILYTAZV4LZPKX5UPLTEFZFZMOJAYP6TOS7NBYEQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.397073840 (205h52m49.536058034s) [noise=true , address=185.167.204.205:4007 , piece_id=JLIPTELJREGJOQ3QFEAYFVK7LGPP76P6SWFTAO55UWSDCWVLAXPQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.398268522 (205h52m49.537252716s) [noise=true , address=185.167.204.205:4001 , piece_id=S7WH76K7S5YXIPITAOXZEMDLNSU37OVUPAJTSDLKDZXOWA4ZSK5Q, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.399416968 (205h52m49.538401152s) [noise=true , address=185.167.204.206:4056 , piece_id=7UF37JHCZ5G5EQEQ5GIC7PTV25C6EI6NT7M4FSKJ2OTPXY5JFEKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403130474 (205h52m49.542114668s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403591676 (205h52m49.542575859s) [noise=true , address=185.167.204.205:4032 , piece_id=NGBF5HYMNPYSPTVI2JL2SDKZKYBMCCJMZOHSZY7XCNDKZIHPWE3A, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414509660 (205h52m49.553493854s) [noise=true , address=185.167.204.205:4025 , piece_id=FRYYUJ4TAT2BZTJQZZB4JV7C5IJLZ4NWE6Y2YSKUIWSJPK4GLVDQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414697802 (205h52m49.553681986s) [noise=true , address=185.167.204.206:4053 , piece_id=HGASLIXZAUTS5EYUDJLUF7UUMF6XKJCBM4RNAWT5KZOMNTI5LEXA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422389459 (205h52m49.561373644s) [noise=true , address=89.149.201.147:4009 , piece_id=IZ4XME6VRUIK57TTTQT2US3WN4UCYKITLHX7YOHKWX64DZJ7YELA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422869808 (205h52m49.561853991s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.424793150 (205h52m49.563777344s) [noise=true , address=185.167.204.205:4004 , piece_id=GFWCT5MZWD4WLMQIGPR4LIZLTIKYTCYVFJYR2TDKLI5YX6MG7QBA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.425071389 (205h52m49.564055583s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.426571973 (205h52m49.565556158s) [noise=true , address=89.149.201.147:4017 , piece_id=HNRWXPXSFBI3VSHPB2EUHZENVX4FPBDA6QU6ACZL3WQQT42TRHAA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.429544084 (205h52m49.568528279s) [noise=true , address=89.149.201.147:4021 , piece_id=NAB3TW4PJP5OMM4JZRHTNMWFOSMJWHL6C6BKB32KZFYNVUIDPHSA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.441315013 (205h52m49.580299227s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.442787123 (205h52m49.581771338s) [noise=true , address=185.167.204.206:4054 , piece_id=LSHPBDWHD3BR4U34FDKFAYBX755JHU3JA35ELIAVCTHDOCHLRXPA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.443177042 (205h52m49.582161266s) [noise=true , address=185.167.204.206:4065 , piece_id=HHK34DOZ2S2RUS2L36TXAKPEFGVY5AXVFWSVVNRVIFC2SFC6H3ZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458482813 (205h52m49.597467027s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458495036 (205h52m49.59747925s) [seg_pos={0 0}, upload=181027]: Satisfied cohort requirements after 26 pieces
Feb 26 10:01:30.458652260 (205h52m49.597636473s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458661277 (205h52m49.59764549s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458784807 (205h52m49.597769021s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458792612 (205h52m49.597776826s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458810435 (205h52m49.597794649s) [seg_pos={0 0}, upload=181027]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 26 10:01:30.458876719 (205h52m49.597860932s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 26 10:01:30.458881848 (205h52m49.597866052s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 26 10:02:53.288204433 (205h54m12.427188617s) [upload=181027]: Done uploading segments...
Feb 26 10:02:53.288251401 (205h54m12.427235595s) [upload=181027]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.293051278s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
7.091308ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj X-Xss-Protection=1; mode=block Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897C5B0C5A19B28 X-Request-Id=gYHFRsqNsdU Date=Thu, 26 Feb 2026 10:39:01 GMT Accept-Ranges=bytes target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3e1c8b55059becc
FAIL (2026-02-26 10:39:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5B0C5A19B28</RequestId><HostId></HostId></Error>"
Duration: 7.107618ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.238795ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin Date=Thu, 26 Feb 2026 10:38:54 GMT Accept-Ranges=bytes Server=Storj X-Amz-Request-Id=1897C5AF3CADED2B X-Request-Id=7CEYrHYyAyt X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/4d081462cf4b6277
FAIL (2026-02-26 10:38:54 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5AF3CADED2B</RequestId><HostId></HostId></Error>"
Duration: 26.259414ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.748468ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1897C5AE658E83AF Date=Thu, 26 Feb 2026 10:38:51 GMT Content-Type=application/xml Server=Storj X-Request-Id=4FoVwoQ6PrR X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/666338a7504f7ab
FAIL (2026-02-26 10:38:51 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5AE658E83AF</RequestId><HostId></HostId></Error>"
Duration: 26.766491ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
6 out of 60 is failed (threshold=3) [X....X.X..X.X..X............................................] duration:
958.756682ms trace:
https://jaeger.dev.storj.io/trace/34ba754b228106c3
FAIL (2026-02-26 10:38:46 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 958.791677ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
4 out of 60 is failed (threshold=3) [..X....X.X..X...............................................] duration:
2.270627309s trace:
https://jaeger.dev.storj.io/trace/18ca7b98681cce5a
FAIL (2026-02-26 10:38:34 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
ece...
Feb 26 10:01:29.695649955 (205h52m48.834634168s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.695663810 (205h52m48.834648034s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696378264 (205h52m48.835362488s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.696856468 (205h52m48.835840682s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697410122 (205h52m48.836394336s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.697870322 (205h52m48.836854536s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698360618 (205h52m48.837344832s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.698890107 (205h52m48.837874321s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700422690 (205h52m48.839406904s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:29.700908807 (205h52m48.839893022s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Uploading piece...
Feb 26 10:01:30.166437960 (205h52m49.305422164s) [upload=181027]: Next returned nil segment
Feb 26 10:01:30.166448219 (205h52m49.305432414s) [upload=181027]: Waiting for error group managing segments...
Feb 26 10:01:30.357388688 (205h52m49.496372902s) [noise=true , address=81.171.14.70:4037 , piece_id=IMJYVPFFFQTJ4NP6M4HDKLAGWECQIPQVFSRA5HSGXCHZYANPPTCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.361293382 (205h52m49.500277595s) [noise=true , address=185.167.204.206:4055 , piece_id=MCMGGOUVBRYS27BBYDSAAIHEYXTFODUGZGHINLOI3A4LKUWALLQQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.373763386 (205h52m49.5127476s) [noise=true , address=81.171.14.70:4032 , piece_id=7MAUJX2IV3EELPUCWXVPAESVX6YCRIKHUV6GBOFZHAXYEBSZ55JA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.381652062 (205h52m49.520636287s) [noise=true , address=185.167.204.206:4041 , piece_id=NDQZ6TJ4NJHXQAEOAZVTUUM5C5SIP2VXXHNXZ5NL5QUO3UR27KCQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.386647563 (205h52m49.525631778s) [noise=true , address=81.171.14.70:4031 , piece_id=TLE6XV5AHH6YXOLA5OXHZTQHIAI6AU464DV2JGO52PZTXYFEYWKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.388750942 (205h52m49.527735167s) [noise=true , address=185.167.204.206:4063 , piece_id=NMA7QKSEEA22LT7IUG3V47QQLRF4SX3IWTTXLWOE2M55HHTKMDUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.389146813 (205h52m49.528131027s) [noise=true , address=185.167.204.206:4057 , piece_id=W6VZZ6VF3OLV4HJMHGCZUGJ3VS77HZZDNPIDIODXA4YSDLQXVSIA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.390513335 (205h52m49.52949756s) [noise=true , address=185.167.204.206:4058 , piece_id=42AIWHF5K6PXMMT4C4EL5E2XPKX63YCBM5VA5JS5ZCYTT7F7ZWDA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.392292178 (205h52m49.531276402s) [noise=true , address=81.171.14.70:4044 , piece_id=E5EMT7SH3SQRGILYTAZV4LZPKX5UPLTEFZFZMOJAYP6TOS7NBYEQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.397073840 (205h52m49.536058034s) [noise=true , address=185.167.204.205:4007 , piece_id=JLIPTELJREGJOQ3QFEAYFVK7LGPP76P6SWFTAO55UWSDCWVLAXPQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.398268522 (205h52m49.537252716s) [noise=true , address=185.167.204.205:4001 , piece_id=S7WH76K7S5YXIPITAOXZEMDLNSU37OVUPAJTSDLKDZXOWA4ZSK5Q, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.399416968 (205h52m49.538401152s) [noise=true , address=185.167.204.206:4056 , piece_id=7UF37JHCZ5G5EQEQ5GIC7PTV25C6EI6NT7M4FSKJ2OTPXY5JFEKA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403130474 (205h52m49.542114668s) [noise=true , address=185.167.204.206:4069 , piece_id=ULNXNF2DYK6RCKABS5RGRUPIADJCJDWQ672D7NFAPCE2EL6YFQZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.403591676 (205h52m49.542575859s) [noise=true , address=185.167.204.205:4032 , piece_id=NGBF5HYMNPYSPTVI2JL2SDKZKYBMCCJMZOHSZY7XCNDKZIHPWE3A, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414509660 (205h52m49.553493854s) [noise=true , address=185.167.204.205:4025 , piece_id=FRYYUJ4TAT2BZTJQZZB4JV7C5IJLZ4NWE6Y2YSKUIWSJPK4GLVDQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.414697802 (205h52m49.553681986s) [noise=true , address=185.167.204.206:4053 , piece_id=HGASLIXZAUTS5EYUDJLUF7UUMF6XKJCBM4RNAWT5KZOMNTI5LEXA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422389459 (205h52m49.561373644s) [noise=true , address=89.149.201.147:4009 , piece_id=IZ4XME6VRUIK57TTTQT2US3WN4UCYKITLHX7YOHKWX64DZJ7YELA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.422869808 (205h52m49.561853991s) [noise=true , address=185.167.204.205:4028 , piece_id=PMJ4JXHFBNJDN24IIIXONY4AAXZ72GI66YDUW7RQXCFKLG3VCFJQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.424793150 (205h52m49.563777344s) [noise=true , address=185.167.204.205:4004 , piece_id=GFWCT5MZWD4WLMQIGPR4LIZLTIKYTCYVFJYR2TDKLI5YX6MG7QBA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.425071389 (205h52m49.564055583s) [noise=true , address=185.167.204.205:4002 , piece_id=A6V4EN5XBVYRUFTDZST52OJEV7FKBW4CGDYL6BYKMZ4STIKK6HZQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.426571973 (205h52m49.565556158s) [noise=true , address=89.149.201.147:4017 , piece_id=HNRWXPXSFBI3VSHPB2EUHZENVX4FPBDA6QU6ACZL3WQQT42TRHAA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.429544084 (205h52m49.568528279s) [noise=true , address=89.149.201.147:4021 , piece_id=NAB3TW4PJP5OMM4JZRHTNMWFOSMJWHL6C6BKB32KZFYNVUIDPHSA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.441315013 (205h52m49.580299227s) [noise=true , address=81.171.14.70:4039 , piece_id=VP73FLXHQ7NZ4W4RQOKSD5UCXB2YJUWZK7534CQO5LRIH7EV75IQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.442787123 (205h52m49.581771338s) [noise=true , address=185.167.204.206:4054 , piece_id=LSHPBDWHD3BR4U34FDKFAYBX755JHU3JA35ELIAVCTHDOCHLRXPA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.443177042 (205h52m49.582161266s) [noise=true , address=185.167.204.206:4065 , piece_id=HHK34DOZ2S2RUS2L36TXAKPEFGVY5AXVFWSVVNRVIFC2SFC6H3ZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458482813 (205h52m49.597467027s) [noise=true , address=89.149.201.147:4023 , piece_id=63F23SANOAVAOTR4P45XDUWLRAI5BPT6OBVLA6J3CVYAZQKMQABQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: <nil>
Feb 26 10:01:30.458495036 (205h52m49.59747925s) [seg_pos={0 0}, upload=181027]: Satisfied cohort requirements after 26 pieces
Feb 26 10:01:30.458652260 (205h52m49.597636473s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458661277 (205h52m49.59764549s) [noise=true , address=89.149.201.147:4014 , piece_id=EEZWUD7LLBUDAH7GG2PXRRRWOZBCVEEQFIWVILOEGSWREHEOQGZA, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458784807 (205h52m49.597769021s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde): protocol: expected piece hash; context canceled; EOF
Feb 26 10:01:30.458792612 (205h52m49.597776826s) [noise=true , address=81.171.14.70:4030 , piece_id=DPTEUGCEIXLP3JWSDEP6VNB3TLWHGGVE4ANOKQ6ZJLMSQQAX7YUQ, seg_pos={0 0}, upload=181027]: Long tail cancellation due to optimal threshold
Feb 26 10:01:30.458810435 (205h52m49.597794649s) [seg_pos={0 0}, upload=181027]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Feb 26 10:01:30.458876719 (205h52m49.597860932s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 26 10:01:30.458881848 (205h52m49.597866052s) [upload=181027]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 26 10:02:53.288204433 (205h54m12.427188617s) [upload=181027]: Done uploading segments...
Feb 26 10:02:53.288251401 (205h54m12.427235595s) [upload=181027]: Upload finished. err: metaclient: context deadline exceeded
Duration: 2.270651404s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
17.173018ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1897C5A9245D3C5D X-Request-Id=XkhQ2w1JscA Date=Thu, 26 Feb 2026 10:38:28 GMT Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/109266291ade010e
FAIL (2026-02-26 10:38:28 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897C5A9245D3C5D</RequestId><HostId></HostId></Error>"
Duration: 17.186785ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)antiblip:
3 out of 60 is failed (threshold=3) [.....XX.....X...............................................] duration:
294.411704ms target:
https://eu1.storj.io/login trace:
https://jaeger.dev.storj.io/trace/103aca994b3c267e
FAIL (2026-02-26 10:38:25 UTC)
orbiter warning: Get "https://eu1.storj.io/login": dial tcp 35.207.121.91:443: i/o timeout
Duration: 294.433455ms
core
satellite
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.....X.....................................................] duration:
2.977082321s trace:
https://jaeger.dev.storj.io/trace/7fdafaffa97b0fec
FAIL (2026-02-26 10:38:14 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.977107499s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X....X.X..X.X..X...........................................] duration:
933.615797ms trace:
https://jaeger.dev.storj.io/trace/34ba754b228106c3
FAIL (2026-02-26 10:38:14 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 933.637127ms
core
uplink
eu1
|