Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
913.677598ms trace:
https://jaeger.dev.storj.io/trace/666feae5ab81832a
FAIL (2026-02-25 19:58:27 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 913.69513ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.X............XX..........................................] duration:
2.944237935s trace:
https://jaeger.dev.storj.io/trace/351ddb90b1764fd3
FAIL (2026-02-25 19:58:19 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.944263755s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................................XX.......] duration:
396.181796ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 19:58:05 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 396.245494ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.074296ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=1897959E18EDFBFE X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:58:04 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=HKJ4D4oyJQf target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/685e32f5e1ebb900
FAIL (2026-02-25 19:58:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897959E18EDFBFE</RequestId><HostId></HostId></Error>"
Duration: 24.09228ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.233123076s trace:
https://jaeger.dev.storj.io/trace/1fe01af1829f0be1
FAIL (2026-02-25 19:57:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421454648 (191h44m38.560438832s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421578089 (191h44m38.560562283s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421728089 (191h44m38.560712283s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422017611 (191h44m38.561001805s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422060290 (191h44m38.561044474s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422282916 (191h44m38.56126711s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422655902 (191h44m38.561640086s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422837041 (191h44m38.561821235s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.423092007 (191h44m38.562076201s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.430566942 (191h44m38.569551137s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.432103813 (191h44m38.571088007s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.893905905 (191h44m39.03289012s) [upload=168595]: Next returned nil segment
Feb 25 19:53:19.893924289 (191h44m39.032908513s) [upload=168595]: Waiting for error group managing segments...
Feb 25 19:53:20.057105011 (191h44m39.196089225s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.062110133 (191h44m39.201094346s) [noise=true , address=81.171.14.70:4038 , piece_id=NWGOFS3B24NHEYMRDL33LDA3YD6XACUW2CMLFG74B2WN55R6A73A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.077016472 (191h44m39.216000685s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.080640101 (191h44m39.219624315s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.081710791 (191h44m39.220695005s) [noise=true , address=81.171.14.70:4043 , piece_id=XDBJJZDEKYV4KILNC5NDYZXHYCPC5JI6DSIH3Q3FMGP334FYNLOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.082415427 (191h44m39.221399641s) [noise=true , address=185.167.204.206:4063 , piece_id=JRIRXSJPQUOVZYQ2VOVBRLSHFEV52LFYCFKY3SI3KKS4O247CMFQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.089072265 (191h44m39.228056478s) [noise=true , address=81.171.14.70:4045 , piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.093745155 (191h44m39.232729369s) [noise=true , address=185.167.204.206:4058 , piece_id=TEDZH2KKMZBASS7XSWFOPZ6BZUAQAJ6U6NMFZXKSDEBGO3SMNJZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.099158497 (191h44m39.238142711s) [noise=true , address=185.167.204.206:4054 , piece_id=RWM25MOHLCPVNATEGKYJJVA6CJJNMBZ2MUNX7C5SQ7YWPBXFEVRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.106839228 (191h44m39.245823441s) [noise=true , address=185.167.204.206:4071 , piece_id=X7R4LXHTJ4EVUXGRA5UXDFIYKSD7QUYWESFPFVJWPZJ3PZDVATVA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.108375808 (191h44m39.247360022s) [noise=true , address=81.171.14.70:4040 , piece_id=2J7EQDG4GFWYIT6Z4NWWO3L56SRPRYP6U3LG4AUDUSFKGAOJOBWQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.110162726 (191h44m39.249146951s) [noise=true , address=81.171.14.70:4028 , piece_id=MPDDEJYIQUB5R3QWOHYENYGLYB4SKQOT2Z672FACWY76SKWEWD5A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.111590173 (191h44m39.250574387s) [noise=true , address=185.167.204.206:4055 , piece_id=OGHPESIQ3JCZZ7SV4HX4HN3RSLX3FUNLEPR7Y3KWNJJHYAQGK7ZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.115647433 (191h44m39.254631647s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.118635516 (191h44m39.25761972s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.121613028 (191h44m39.260597242s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.123704996 (191h44m39.262689211s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.127728924 (191h44m39.266713138s) [noise=true , address=185.167.204.205:4017 , piece_id=4WSZ7UHHQXRAYRGK63YKHVQJHKLC2ZUTR5W7XDN5V5Y7NZU3HBXQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.129742255 (191h44m39.268726469s) [noise=true , address=185.167.204.205:4034 , piece_id=SY7S5CSR4LDXAK3JEHZ6TGLKQDRY5ER6YHSCQALW7DT633ADEJUQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.147042467 (191h44m39.286026682s) [noise=true , address=185.167.204.205:4019 , piece_id=2GZCP5TFIWEC77KK4JAQ457FOUVHRPMZEXWIUHZPYMJYQ7SALFOQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.621082182 (191h44m40.760066396s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.693787103 (191h44m40.832771328s) [noise=true , address=89.149.201.147:4015 , piece_id=PX2G72RYQAG3XBJ4EQURYGAWN4PTGUDEUYUMEIM7STT34T5GDACA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:22.075335713 (191h44m41.214319927s) [noise=true , address=89.149.201.147:4021 , piece_id=CEUFYFFN77WRGMNYALBS2EKXEBLK4WNGSN3VJOHNNPMQTZ7CB5WQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:09.191329363 (191h45m28.330313576s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:10.362985909 (191h45m29.501970133s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:19.003151394 (191h45m38.142135638s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF
Feb 25 19:54:19.003245480 (191h45m38.142229674s) [noise=true , address=89.149.201.147:4017 , piece_id=BVJ3PP3DIKR4VJV745R6LFOODFUB53VHUNZVW7MPDPEXIKD26T5Q, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection
Feb 25 19:54:19.003265587 (191h45m38.142249781s) [noise=true , address=89.149.201.147:4024 , piece_id=AKKZHIKUR6XKQKLDRPVRUAKUSUWPD3DW4CJXM6OAO7OMMY54TWZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 5.161.89.252:21760->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 19:54:19.003283972 (191h45m38.142268166s) [seg_pos={0 0}, upload=168595]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 25 19:54:19.113672385 (191h45m38.252656599s) [upload=168595]: Done uploading segments...
Feb 25 19:54:19.113718592 (191h45m38.252702845s) [upload=168595]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.233147362s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
907.36715ms trace:
https://jaeger.dev.storj.io/trace/666feae5ab81832a
FAIL (2026-02-25 19:57:58 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 907.400652ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.106785ms remote:
"tcp:45.38.24.2:443" response headers:
X-Request-Id=ahpgsGTWyhN Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:57:46 GMT Accept-Ranges=bytes Content-Type=application/xml X-Amz-Request-Id=18979599E1DB0722 target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/79678c80e7015798
FAIL (2026-02-25 19:57:46 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979599E1DB0722</RequestId><HostId></HostId></Error>"
Duration: 8.127494ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.602205ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=189795991615533A Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=TnBtWGSKwYg X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:57:43 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2b838c6f695868b4
FAIL (2026-02-25 19:57:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189795991615533A</RequestId><HostId></HostId></Error>"
Duration: 23.618395ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.252762347s trace:
https://jaeger.dev.storj.io/trace/1fe01af1829f0be1
FAIL (2026-02-25 19:57:36 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421454648 (191h44m38.560438832s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421578089 (191h44m38.560562283s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421728089 (191h44m38.560712283s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422017611 (191h44m38.561001805s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422060290 (191h44m38.561044474s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422282916 (191h44m38.56126711s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422655902 (191h44m38.561640086s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422837041 (191h44m38.561821235s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.423092007 (191h44m38.562076201s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.430566942 (191h44m38.569551137s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.432103813 (191h44m38.571088007s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.893905905 (191h44m39.03289012s) [upload=168595]: Next returned nil segment
Feb 25 19:53:19.893924289 (191h44m39.032908513s) [upload=168595]: Waiting for error group managing segments...
Feb 25 19:53:20.057105011 (191h44m39.196089225s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.062110133 (191h44m39.201094346s) [noise=true , address=81.171.14.70:4038 , piece_id=NWGOFS3B24NHEYMRDL33LDA3YD6XACUW2CMLFG74B2WN55R6A73A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.077016472 (191h44m39.216000685s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.080640101 (191h44m39.219624315s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.081710791 (191h44m39.220695005s) [noise=true , address=81.171.14.70:4043 , piece_id=XDBJJZDEKYV4KILNC5NDYZXHYCPC5JI6DSIH3Q3FMGP334FYNLOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.082415427 (191h44m39.221399641s) [noise=true , address=185.167.204.206:4063 , piece_id=JRIRXSJPQUOVZYQ2VOVBRLSHFEV52LFYCFKY3SI3KKS4O247CMFQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.089072265 (191h44m39.228056478s) [noise=true , address=81.171.14.70:4045 , piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.093745155 (191h44m39.232729369s) [noise=true , address=185.167.204.206:4058 , piece_id=TEDZH2KKMZBASS7XSWFOPZ6BZUAQAJ6U6NMFZXKSDEBGO3SMNJZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.099158497 (191h44m39.238142711s) [noise=true , address=185.167.204.206:4054 , piece_id=RWM25MOHLCPVNATEGKYJJVA6CJJNMBZ2MUNX7C5SQ7YWPBXFEVRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.106839228 (191h44m39.245823441s) [noise=true , address=185.167.204.206:4071 , piece_id=X7R4LXHTJ4EVUXGRA5UXDFIYKSD7QUYWESFPFVJWPZJ3PZDVATVA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.108375808 (191h44m39.247360022s) [noise=true , address=81.171.14.70:4040 , piece_id=2J7EQDG4GFWYIT6Z4NWWO3L56SRPRYP6U3LG4AUDUSFKGAOJOBWQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.110162726 (191h44m39.249146951s) [noise=true , address=81.171.14.70:4028 , piece_id=MPDDEJYIQUB5R3QWOHYENYGLYB4SKQOT2Z672FACWY76SKWEWD5A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.111590173 (191h44m39.250574387s) [noise=true , address=185.167.204.206:4055 , piece_id=OGHPESIQ3JCZZ7SV4HX4HN3RSLX3FUNLEPR7Y3KWNJJHYAQGK7ZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.115647433 (191h44m39.254631647s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.118635516 (191h44m39.25761972s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.121613028 (191h44m39.260597242s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.123704996 (191h44m39.262689211s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.127728924 (191h44m39.266713138s) [noise=true , address=185.167.204.205:4017 , piece_id=4WSZ7UHHQXRAYRGK63YKHVQJHKLC2ZUTR5W7XDN5V5Y7NZU3HBXQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.129742255 (191h44m39.268726469s) [noise=true , address=185.167.204.205:4034 , piece_id=SY7S5CSR4LDXAK3JEHZ6TGLKQDRY5ER6YHSCQALW7DT633ADEJUQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.147042467 (191h44m39.286026682s) [noise=true , address=185.167.204.205:4019 , piece_id=2GZCP5TFIWEC77KK4JAQ457FOUVHRPMZEXWIUHZPYMJYQ7SALFOQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.621082182 (191h44m40.760066396s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.693787103 (191h44m40.832771328s) [noise=true , address=89.149.201.147:4015 , piece_id=PX2G72RYQAG3XBJ4EQURYGAWN4PTGUDEUYUMEIM7STT34T5GDACA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:22.075335713 (191h44m41.214319927s) [noise=true , address=89.149.201.147:4021 , piece_id=CEUFYFFN77WRGMNYALBS2EKXEBLK4WNGSN3VJOHNNPMQTZ7CB5WQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:09.191329363 (191h45m28.330313576s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:10.362985909 (191h45m29.501970133s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:19.003151394 (191h45m38.142135638s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF
Feb 25 19:54:19.003245480 (191h45m38.142229674s) [noise=true , address=89.149.201.147:4017 , piece_id=BVJ3PP3DIKR4VJV745R6LFOODFUB53VHUNZVW7MPDPEXIKD26T5Q, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection
Feb 25 19:54:19.003265587 (191h45m38.142249781s) [noise=true , address=89.149.201.147:4024 , piece_id=AKKZHIKUR6XKQKLDRPVRUAKUSUWPD3DW4CJXM6OAO7OMMY54TWZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 5.161.89.252:21760->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 19:54:19.003283972 (191h45m38.142268166s) [seg_pos={0 0}, upload=168595]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 25 19:54:19.113672385 (191h45m38.252656599s) [upload=168595]: Done uploading segments...
Feb 25 19:54:19.113718592 (191h45m38.252702845s) [upload=168595]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.252784238s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.504373ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=18979595D91BACF4 Date=Wed, 25 Feb 2026 19:57:29 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=5bWB2J28cUa X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/78d7d995fd3397ef
FAIL (2026-02-25 19:57:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979595D91BACF4</RequestId><HostId></HostId></Error>"
Duration: 23.526264ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
11.442448ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=189795944FEF43F3 X-Request-Id=T83VxstJkrw X-Xss-Protection=1; mode=block Content-Type=application/xml Date=Wed, 25 Feb 2026 19:57:22 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/6c376f76452b008d
FAIL (2026-02-25 19:57:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189795944FEF43F3</RequestId><HostId></HostId></Error>"
Duration: 11.457084ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.758489ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1897959446F195A3 X-Request-Id=Fn3uGZqkQt6 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:57:22 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/4748cb83fe14d057
FAIL (2026-02-25 19:57:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897959446F195A3</RequestId><HostId></HostId></Error>"
Duration: 22.775772ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
30.592064ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18979593E33268A8 Content-Type=application/xml Server=Storj X-Request-Id=d6PbeXoSjHG X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:57:20 GMT Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/73de86fc2cb37388
FAIL (2026-02-25 19:57:20 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979593E33268A8</RequestId><HostId></HostId></Error>"
Duration: 30.607503ms
edge
gateway
vhost
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................................XX......] duration:
365.038075ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 19:57:13 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 365.063943ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X.X............XX.........................................] duration:
3.294445939s trace:
https://jaeger.dev.storj.io/trace/351ddb90b1764fd3
FAIL (2026-02-25 19:57:10 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.294460837s
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.288603458s trace:
https://jaeger.dev.storj.io/trace/1fe01af1829f0be1
FAIL (2026-02-25 19:56:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421454648 (191h44m38.560438832s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421578089 (191h44m38.560562283s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421728089 (191h44m38.560712283s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422017611 (191h44m38.561001805s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422060290 (191h44m38.561044474s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422282916 (191h44m38.56126711s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422655902 (191h44m38.561640086s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422837041 (191h44m38.561821235s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.423092007 (191h44m38.562076201s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.430566942 (191h44m38.569551137s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.432103813 (191h44m38.571088007s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.893905905 (191h44m39.03289012s) [upload=168595]: Next returned nil segment
Feb 25 19:53:19.893924289 (191h44m39.032908513s) [upload=168595]: Waiting for error group managing segments...
Feb 25 19:53:20.057105011 (191h44m39.196089225s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.062110133 (191h44m39.201094346s) [noise=true , address=81.171.14.70:4038 , piece_id=NWGOFS3B24NHEYMRDL33LDA3YD6XACUW2CMLFG74B2WN55R6A73A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.077016472 (191h44m39.216000685s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.080640101 (191h44m39.219624315s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.081710791 (191h44m39.220695005s) [noise=true , address=81.171.14.70:4043 , piece_id=XDBJJZDEKYV4KILNC5NDYZXHYCPC5JI6DSIH3Q3FMGP334FYNLOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.082415427 (191h44m39.221399641s) [noise=true , address=185.167.204.206:4063 , piece_id=JRIRXSJPQUOVZYQ2VOVBRLSHFEV52LFYCFKY3SI3KKS4O247CMFQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.089072265 (191h44m39.228056478s) [noise=true , address=81.171.14.70:4045 , piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.093745155 (191h44m39.232729369s) [noise=true , address=185.167.204.206:4058 , piece_id=TEDZH2KKMZBASS7XSWFOPZ6BZUAQAJ6U6NMFZXKSDEBGO3SMNJZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.099158497 (191h44m39.238142711s) [noise=true , address=185.167.204.206:4054 , piece_id=RWM25MOHLCPVNATEGKYJJVA6CJJNMBZ2MUNX7C5SQ7YWPBXFEVRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.106839228 (191h44m39.245823441s) [noise=true , address=185.167.204.206:4071 , piece_id=X7R4LXHTJ4EVUXGRA5UXDFIYKSD7QUYWESFPFVJWPZJ3PZDVATVA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.108375808 (191h44m39.247360022s) [noise=true , address=81.171.14.70:4040 , piece_id=2J7EQDG4GFWYIT6Z4NWWO3L56SRPRYP6U3LG4AUDUSFKGAOJOBWQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.110162726 (191h44m39.249146951s) [noise=true , address=81.171.14.70:4028 , piece_id=MPDDEJYIQUB5R3QWOHYENYGLYB4SKQOT2Z672FACWY76SKWEWD5A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.111590173 (191h44m39.250574387s) [noise=true , address=185.167.204.206:4055 , piece_id=OGHPESIQ3JCZZ7SV4HX4HN3RSLX3FUNLEPR7Y3KWNJJHYAQGK7ZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.115647433 (191h44m39.254631647s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.118635516 (191h44m39.25761972s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.121613028 (191h44m39.260597242s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.123704996 (191h44m39.262689211s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.127728924 (191h44m39.266713138s) [noise=true , address=185.167.204.205:4017 , piece_id=4WSZ7UHHQXRAYRGK63YKHVQJHKLC2ZUTR5W7XDN5V5Y7NZU3HBXQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.129742255 (191h44m39.268726469s) [noise=true , address=185.167.204.205:4034 , piece_id=SY7S5CSR4LDXAK3JEHZ6TGLKQDRY5ER6YHSCQALW7DT633ADEJUQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.147042467 (191h44m39.286026682s) [noise=true , address=185.167.204.205:4019 , piece_id=2GZCP5TFIWEC77KK4JAQ457FOUVHRPMZEXWIUHZPYMJYQ7SALFOQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.621082182 (191h44m40.760066396s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.693787103 (191h44m40.832771328s) [noise=true , address=89.149.201.147:4015 , piece_id=PX2G72RYQAG3XBJ4EQURYGAWN4PTGUDEUYUMEIM7STT34T5GDACA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:22.075335713 (191h44m41.214319927s) [noise=true , address=89.149.201.147:4021 , piece_id=CEUFYFFN77WRGMNYALBS2EKXEBLK4WNGSN3VJOHNNPMQTZ7CB5WQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:09.191329363 (191h45m28.330313576s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:10.362985909 (191h45m29.501970133s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:19.003151394 (191h45m38.142135638s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF
Feb 25 19:54:19.003245480 (191h45m38.142229674s) [noise=true , address=89.149.201.147:4017 , piece_id=BVJ3PP3DIKR4VJV745R6LFOODFUB53VHUNZVW7MPDPEXIKD26T5Q, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection
Feb 25 19:54:19.003265587 (191h45m38.142249781s) [noise=true , address=89.149.201.147:4024 , piece_id=AKKZHIKUR6XKQKLDRPVRUAKUSUWPD3DW4CJXM6OAO7OMMY54TWZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 5.161.89.252:21760->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 19:54:19.003283972 (191h45m38.142268166s) [seg_pos={0 0}, upload=168595]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 25 19:54:19.113672385 (191h45m38.252656599s) [upload=168595]: Done uploading segments...
Feb 25 19:54:19.113718592 (191h45m38.252702845s) [upload=168595]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.28862144s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
900.913413ms trace:
https://jaeger.dev.storj.io/trace/666feae5ab81832a
FAIL (2026-02-25 19:56:56 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 900.942397ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
917.972644ms trace:
https://jaeger.dev.storj.io/trace/666feae5ab81832a
FAIL (2026-02-25 19:56:34 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 917.994764ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
55.366118ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Wed, 25 Feb 2026 19:56:29 GMT Content-Type=application/xml Server=Storj X-Amz-Request-Id=18979587D5533032 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Request-Id=MNKacvwBTEG target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/2bcbeca74d621915
FAIL (2026-02-25 19:56:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979587D5533032</RequestId><HostId></HostId></Error>"
Duration: 55.386887ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.496746ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1897958735AC52BE X-Xss-Protection=1; mode=block Content-Length=274 Content-Type=application/xml Vary=Origin X-Request-Id=UdnL7U2c5Nt Date=Wed, 25 Feb 2026 19:56:26 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/55113be602198d07
FAIL (2026-02-25 19:56:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897958735AC52BE</RequestId><HostId></HostId></Error>"
Duration: 24.517436ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.317723456s trace:
https://jaeger.dev.storj.io/trace/1fe01af1829f0be1
FAIL (2026-02-25 19:56:25 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421454648 (191h44m38.560438832s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421578089 (191h44m38.560562283s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421728089 (191h44m38.560712283s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422017611 (191h44m38.561001805s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422060290 (191h44m38.561044474s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422282916 (191h44m38.56126711s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422655902 (191h44m38.561640086s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422837041 (191h44m38.561821235s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.423092007 (191h44m38.562076201s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.430566942 (191h44m38.569551137s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.432103813 (191h44m38.571088007s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.893905905 (191h44m39.03289012s) [upload=168595]: Next returned nil segment
Feb 25 19:53:19.893924289 (191h44m39.032908513s) [upload=168595]: Waiting for error group managing segments...
Feb 25 19:53:20.057105011 (191h44m39.196089225s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.062110133 (191h44m39.201094346s) [noise=true , address=81.171.14.70:4038 , piece_id=NWGOFS3B24NHEYMRDL33LDA3YD6XACUW2CMLFG74B2WN55R6A73A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.077016472 (191h44m39.216000685s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.080640101 (191h44m39.219624315s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.081710791 (191h44m39.220695005s) [noise=true , address=81.171.14.70:4043 , piece_id=XDBJJZDEKYV4KILNC5NDYZXHYCPC5JI6DSIH3Q3FMGP334FYNLOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.082415427 (191h44m39.221399641s) [noise=true , address=185.167.204.206:4063 , piece_id=JRIRXSJPQUOVZYQ2VOVBRLSHFEV52LFYCFKY3SI3KKS4O247CMFQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.089072265 (191h44m39.228056478s) [noise=true , address=81.171.14.70:4045 , piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.093745155 (191h44m39.232729369s) [noise=true , address=185.167.204.206:4058 , piece_id=TEDZH2KKMZBASS7XSWFOPZ6BZUAQAJ6U6NMFZXKSDEBGO3SMNJZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.099158497 (191h44m39.238142711s) [noise=true , address=185.167.204.206:4054 , piece_id=RWM25MOHLCPVNATEGKYJJVA6CJJNMBZ2MUNX7C5SQ7YWPBXFEVRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.106839228 (191h44m39.245823441s) [noise=true , address=185.167.204.206:4071 , piece_id=X7R4LXHTJ4EVUXGRA5UXDFIYKSD7QUYWESFPFVJWPZJ3PZDVATVA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.108375808 (191h44m39.247360022s) [noise=true , address=81.171.14.70:4040 , piece_id=2J7EQDG4GFWYIT6Z4NWWO3L56SRPRYP6U3LG4AUDUSFKGAOJOBWQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.110162726 (191h44m39.249146951s) [noise=true , address=81.171.14.70:4028 , piece_id=MPDDEJYIQUB5R3QWOHYENYGLYB4SKQOT2Z672FACWY76SKWEWD5A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.111590173 (191h44m39.250574387s) [noise=true , address=185.167.204.206:4055 , piece_id=OGHPESIQ3JCZZ7SV4HX4HN3RSLX3FUNLEPR7Y3KWNJJHYAQGK7ZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.115647433 (191h44m39.254631647s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.118635516 (191h44m39.25761972s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.121613028 (191h44m39.260597242s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.123704996 (191h44m39.262689211s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.127728924 (191h44m39.266713138s) [noise=true , address=185.167.204.205:4017 , piece_id=4WSZ7UHHQXRAYRGK63YKHVQJHKLC2ZUTR5W7XDN5V5Y7NZU3HBXQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.129742255 (191h44m39.268726469s) [noise=true , address=185.167.204.205:4034 , piece_id=SY7S5CSR4LDXAK3JEHZ6TGLKQDRY5ER6YHSCQALW7DT633ADEJUQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.147042467 (191h44m39.286026682s) [noise=true , address=185.167.204.205:4019 , piece_id=2GZCP5TFIWEC77KK4JAQ457FOUVHRPMZEXWIUHZPYMJYQ7SALFOQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.621082182 (191h44m40.760066396s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.693787103 (191h44m40.832771328s) [noise=true , address=89.149.201.147:4015 , piece_id=PX2G72RYQAG3XBJ4EQURYGAWN4PTGUDEUYUMEIM7STT34T5GDACA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:22.075335713 (191h44m41.214319927s) [noise=true , address=89.149.201.147:4021 , piece_id=CEUFYFFN77WRGMNYALBS2EKXEBLK4WNGSN3VJOHNNPMQTZ7CB5WQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:09.191329363 (191h45m28.330313576s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:10.362985909 (191h45m29.501970133s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:19.003151394 (191h45m38.142135638s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF
Feb 25 19:54:19.003245480 (191h45m38.142229674s) [noise=true , address=89.149.201.147:4017 , piece_id=BVJ3PP3DIKR4VJV745R6LFOODFUB53VHUNZVW7MPDPEXIKD26T5Q, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection
Feb 25 19:54:19.003265587 (191h45m38.142249781s) [noise=true , address=89.149.201.147:4024 , piece_id=AKKZHIKUR6XKQKLDRPVRUAKUSUWPD3DW4CJXM6OAO7OMMY54TWZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 5.161.89.252:21760->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 19:54:19.003283972 (191h45m38.142268166s) [seg_pos={0 0}, upload=168595]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 25 19:54:19.113672385 (191h45m38.252656599s) [upload=168595]: Done uploading segments...
Feb 25 19:54:19.113718592 (191h45m38.252702845s) [upload=168595]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.317739666s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.51503ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Amz-Request-Id=18979586EF23D01C X-Request-Id=4vGDDBFG8KE Date=Wed, 25 Feb 2026 19:56:25 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/302297f3bb035cd1
FAIL (2026-02-25 19:56:25 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979586EF23D01C</RequestId><HostId></HostId></Error>"
Duration: 24.534868ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.298064ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=18979586D6CDC9DC X-Request-Id=VzhuQ9R3oSW X-Xss-Protection=1; mode=block Content-Length=284 Date=Wed, 25 Feb 2026 19:56:24 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/13f64fc79530edb0
FAIL (2026-02-25 19:56:24 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979586D6CDC9DC</RequestId><HostId></HostId></Error>"
Duration: 8.311689ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
18.471008ms remote:
"tcp:45.38.24.2:443" response headers:
Date=Wed, 25 Feb 2026 19:56:04 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=189795822AB2FE1C X-Request-Id=7xWMXc7gY95 Content-Length=284 Content-Type=application/xml Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7fc061fd3b664945
FAIL (2026-02-25 19:56:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189795822AB2FE1C</RequestId><HostId></HostId></Error>"
Duration: 18.49344ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
40.986443ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Request-Id=3MquF2vrQzm X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:56:04 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1897958206FF17A3 Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/5ad1be0af450190f
FAIL (2026-02-25 19:56:04 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897958206FF17A3</RequestId><HostId></HostId></Error>"
Duration: 41.03313ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
916.315205ms trace:
https://jaeger.dev.storj.io/trace/666feae5ab81832a
FAIL (2026-02-25 19:56:03 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 916.37115ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X.X............XX........................................] duration:
2.753804074s trace:
https://jaeger.dev.storj.io/trace/351ddb90b1764fd3
FAIL (2026-02-25 19:56:00 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.753840732s
core
uplink
eu1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration:
381.847175ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 19:55:59 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 381.864307ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
928.635464ms trace:
https://jaeger.dev.storj.io/trace/666feae5ab81832a
FAIL (2026-02-25 19:55:47 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 928.649051ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.248215668s trace:
https://jaeger.dev.storj.io/trace/1fe01af1829f0be1
FAIL (2026-02-25 19:55:45 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421454648 (191h44m38.560438832s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421578089 (191h44m38.560562283s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421728089 (191h44m38.560712283s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422017611 (191h44m38.561001805s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422060290 (191h44m38.561044474s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422282916 (191h44m38.56126711s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422655902 (191h44m38.561640086s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422837041 (191h44m38.561821235s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.423092007 (191h44m38.562076201s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.430566942 (191h44m38.569551137s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.432103813 (191h44m38.571088007s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.893905905 (191h44m39.03289012s) [upload=168595]: Next returned nil segment
Feb 25 19:53:19.893924289 (191h44m39.032908513s) [upload=168595]: Waiting for error group managing segments...
Feb 25 19:53:20.057105011 (191h44m39.196089225s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.062110133 (191h44m39.201094346s) [noise=true , address=81.171.14.70:4038 , piece_id=NWGOFS3B24NHEYMRDL33LDA3YD6XACUW2CMLFG74B2WN55R6A73A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.077016472 (191h44m39.216000685s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.080640101 (191h44m39.219624315s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.081710791 (191h44m39.220695005s) [noise=true , address=81.171.14.70:4043 , piece_id=XDBJJZDEKYV4KILNC5NDYZXHYCPC5JI6DSIH3Q3FMGP334FYNLOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.082415427 (191h44m39.221399641s) [noise=true , address=185.167.204.206:4063 , piece_id=JRIRXSJPQUOVZYQ2VOVBRLSHFEV52LFYCFKY3SI3KKS4O247CMFQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.089072265 (191h44m39.228056478s) [noise=true , address=81.171.14.70:4045 , piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.093745155 (191h44m39.232729369s) [noise=true , address=185.167.204.206:4058 , piece_id=TEDZH2KKMZBASS7XSWFOPZ6BZUAQAJ6U6NMFZXKSDEBGO3SMNJZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.099158497 (191h44m39.238142711s) [noise=true , address=185.167.204.206:4054 , piece_id=RWM25MOHLCPVNATEGKYJJVA6CJJNMBZ2MUNX7C5SQ7YWPBXFEVRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.106839228 (191h44m39.245823441s) [noise=true , address=185.167.204.206:4071 , piece_id=X7R4LXHTJ4EVUXGRA5UXDFIYKSD7QUYWESFPFVJWPZJ3PZDVATVA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.108375808 (191h44m39.247360022s) [noise=true , address=81.171.14.70:4040 , piece_id=2J7EQDG4GFWYIT6Z4NWWO3L56SRPRYP6U3LG4AUDUSFKGAOJOBWQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.110162726 (191h44m39.249146951s) [noise=true , address=81.171.14.70:4028 , piece_id=MPDDEJYIQUB5R3QWOHYENYGLYB4SKQOT2Z672FACWY76SKWEWD5A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.111590173 (191h44m39.250574387s) [noise=true , address=185.167.204.206:4055 , piece_id=OGHPESIQ3JCZZ7SV4HX4HN3RSLX3FUNLEPR7Y3KWNJJHYAQGK7ZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.115647433 (191h44m39.254631647s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.118635516 (191h44m39.25761972s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.121613028 (191h44m39.260597242s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.123704996 (191h44m39.262689211s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.127728924 (191h44m39.266713138s) [noise=true , address=185.167.204.205:4017 , piece_id=4WSZ7UHHQXRAYRGK63YKHVQJHKLC2ZUTR5W7XDN5V5Y7NZU3HBXQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.129742255 (191h44m39.268726469s) [noise=true , address=185.167.204.205:4034 , piece_id=SY7S5CSR4LDXAK3JEHZ6TGLKQDRY5ER6YHSCQALW7DT633ADEJUQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.147042467 (191h44m39.286026682s) [noise=true , address=185.167.204.205:4019 , piece_id=2GZCP5TFIWEC77KK4JAQ457FOUVHRPMZEXWIUHZPYMJYQ7SALFOQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.621082182 (191h44m40.760066396s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.693787103 (191h44m40.832771328s) [noise=true , address=89.149.201.147:4015 , piece_id=PX2G72RYQAG3XBJ4EQURYGAWN4PTGUDEUYUMEIM7STT34T5GDACA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:22.075335713 (191h44m41.214319927s) [noise=true , address=89.149.201.147:4021 , piece_id=CEUFYFFN77WRGMNYALBS2EKXEBLK4WNGSN3VJOHNNPMQTZ7CB5WQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:09.191329363 (191h45m28.330313576s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:10.362985909 (191h45m29.501970133s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:19.003151394 (191h45m38.142135638s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF
Feb 25 19:54:19.003245480 (191h45m38.142229674s) [noise=true , address=89.149.201.147:4017 , piece_id=BVJ3PP3DIKR4VJV745R6LFOODFUB53VHUNZVW7MPDPEXIKD26T5Q, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection
Feb 25 19:54:19.003265587 (191h45m38.142249781s) [noise=true , address=89.149.201.147:4024 , piece_id=AKKZHIKUR6XKQKLDRPVRUAKUSUWPD3DW4CJXM6OAO7OMMY54TWZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 5.161.89.252:21760->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 19:54:19.003283972 (191h45m38.142268166s) [seg_pos={0 0}, upload=168595]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 25 19:54:19.113672385 (191h45m38.252656599s) [upload=168595]: Done uploading segments...
Feb 25 19:54:19.113718592 (191h45m38.252702845s) [upload=168595]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.248234513s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................................XX....] duration:
366.115887ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 19:55:41 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 366.140784ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.888692ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Amz-Request-Id=18979579E15C5C58 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml X-Request-Id=L1fMy9kUxAP Date=Wed, 25 Feb 2026 19:55:29 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/43e9e9bee99cf4db
FAIL (2026-02-25 19:55:29 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979579E15C5C58</RequestId><HostId></HostId></Error>"
Duration: 22.90369ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.098994ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Request-Id=4Xw4zsqQfJW Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1897957857237BAE X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:55:22 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/25b0732942b0ff39
FAIL (2026-02-25 19:55:22 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897957857237BAE</RequestId><HostId></HostId></Error>"
Duration: 23.117959ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
910.408609ms trace:
https://jaeger.dev.storj.io/trace/666feae5ab81832a
FAIL (2026-02-25 19:55:19 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 910.429108ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X.X............XX.......................................] duration:
2.984626476s trace:
https://jaeger.dev.storj.io/trace/351ddb90b1764fd3
FAIL (2026-02-25 19:55:18 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 2.984653958s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.399573ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=1897957682500753 Date=Wed, 25 Feb 2026 19:55:14 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=XCkbdszo2YD X-Xss-Protection=1; mode=block Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/272deea7d9fcc612
FAIL (2026-02-25 19:55:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897957682500753</RequestId><HostId></HostId></Error>"
Duration: 31.421274ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.267165082s trace:
https://jaeger.dev.storj.io/trace/1fe01af1829f0be1
FAIL (2026-02-25 19:55:10 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421454648 (191h44m38.560438832s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421578089 (191h44m38.560562283s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421728089 (191h44m38.560712283s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422017611 (191h44m38.561001805s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422060290 (191h44m38.561044474s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422282916 (191h44m38.56126711s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422655902 (191h44m38.561640086s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422837041 (191h44m38.561821235s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.423092007 (191h44m38.562076201s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.430566942 (191h44m38.569551137s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.432103813 (191h44m38.571088007s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.893905905 (191h44m39.03289012s) [upload=168595]: Next returned nil segment
Feb 25 19:53:19.893924289 (191h44m39.032908513s) [upload=168595]: Waiting for error group managing segments...
Feb 25 19:53:20.057105011 (191h44m39.196089225s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.062110133 (191h44m39.201094346s) [noise=true , address=81.171.14.70:4038 , piece_id=NWGOFS3B24NHEYMRDL33LDA3YD6XACUW2CMLFG74B2WN55R6A73A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.077016472 (191h44m39.216000685s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.080640101 (191h44m39.219624315s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.081710791 (191h44m39.220695005s) [noise=true , address=81.171.14.70:4043 , piece_id=XDBJJZDEKYV4KILNC5NDYZXHYCPC5JI6DSIH3Q3FMGP334FYNLOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.082415427 (191h44m39.221399641s) [noise=true , address=185.167.204.206:4063 , piece_id=JRIRXSJPQUOVZYQ2VOVBRLSHFEV52LFYCFKY3SI3KKS4O247CMFQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.089072265 (191h44m39.228056478s) [noise=true , address=81.171.14.70:4045 , piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.093745155 (191h44m39.232729369s) [noise=true , address=185.167.204.206:4058 , piece_id=TEDZH2KKMZBASS7XSWFOPZ6BZUAQAJ6U6NMFZXKSDEBGO3SMNJZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.099158497 (191h44m39.238142711s) [noise=true , address=185.167.204.206:4054 , piece_id=RWM25MOHLCPVNATEGKYJJVA6CJJNMBZ2MUNX7C5SQ7YWPBXFEVRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.106839228 (191h44m39.245823441s) [noise=true , address=185.167.204.206:4071 , piece_id=X7R4LXHTJ4EVUXGRA5UXDFIYKSD7QUYWESFPFVJWPZJ3PZDVATVA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.108375808 (191h44m39.247360022s) [noise=true , address=81.171.14.70:4040 , piece_id=2J7EQDG4GFWYIT6Z4NWWO3L56SRPRYP6U3LG4AUDUSFKGAOJOBWQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.110162726 (191h44m39.249146951s) [noise=true , address=81.171.14.70:4028 , piece_id=MPDDEJYIQUB5R3QWOHYENYGLYB4SKQOT2Z672FACWY76SKWEWD5A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.111590173 (191h44m39.250574387s) [noise=true , address=185.167.204.206:4055 , piece_id=OGHPESIQ3JCZZ7SV4HX4HN3RSLX3FUNLEPR7Y3KWNJJHYAQGK7ZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.115647433 (191h44m39.254631647s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.118635516 (191h44m39.25761972s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.121613028 (191h44m39.260597242s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.123704996 (191h44m39.262689211s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.127728924 (191h44m39.266713138s) [noise=true , address=185.167.204.205:4017 , piece_id=4WSZ7UHHQXRAYRGK63YKHVQJHKLC2ZUTR5W7XDN5V5Y7NZU3HBXQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.129742255 (191h44m39.268726469s) [noise=true , address=185.167.204.205:4034 , piece_id=SY7S5CSR4LDXAK3JEHZ6TGLKQDRY5ER6YHSCQALW7DT633ADEJUQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.147042467 (191h44m39.286026682s) [noise=true , address=185.167.204.205:4019 , piece_id=2GZCP5TFIWEC77KK4JAQ457FOUVHRPMZEXWIUHZPYMJYQ7SALFOQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.621082182 (191h44m40.760066396s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.693787103 (191h44m40.832771328s) [noise=true , address=89.149.201.147:4015 , piece_id=PX2G72RYQAG3XBJ4EQURYGAWN4PTGUDEUYUMEIM7STT34T5GDACA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:22.075335713 (191h44m41.214319927s) [noise=true , address=89.149.201.147:4021 , piece_id=CEUFYFFN77WRGMNYALBS2EKXEBLK4WNGSN3VJOHNNPMQTZ7CB5WQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:09.191329363 (191h45m28.330313576s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:10.362985909 (191h45m29.501970133s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:19.003151394 (191h45m38.142135638s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF
Feb 25 19:54:19.003245480 (191h45m38.142229674s) [noise=true , address=89.149.201.147:4017 , piece_id=BVJ3PP3DIKR4VJV745R6LFOODFUB53VHUNZVW7MPDPEXIKD26T5Q, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection
Feb 25 19:54:19.003265587 (191h45m38.142249781s) [noise=true , address=89.149.201.147:4024 , piece_id=AKKZHIKUR6XKQKLDRPVRUAKUSUWPD3DW4CJXM6OAO7OMMY54TWZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 5.161.89.252:21760->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 19:54:19.003283972 (191h45m38.142268166s) [seg_pos={0 0}, upload=168595]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 25 19:54:19.113672385 (191h45m38.252656599s) [upload=168595]: Done uploading segments...
Feb 25 19:54:19.113718592 (191h45m38.252702845s) [upload=168595]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.267190069s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.392653ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Amz-Request-Id=1897957477169523 X-Request-Id=DF659PVdkBt Date=Wed, 25 Feb 2026 19:55:05 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5a4f7d65b6688e22
FAIL (2026-02-25 19:55:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897957477169523</RequestId><HostId></HostId></Error>"
Duration: 23.42326ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.896855ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Amz-Request-Id=1897957454353446 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:55:05 GMT Vary=Origin X-Request-Id=EyfqCy1yyNQ target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/20b3af3d71f60724
FAIL (2026-02-25 19:55:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897957454353446</RequestId><HostId></HostId></Error>"
Duration: 23.913937ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.987321ms remote:
"tcp:45.38.24.2:443" response headers:
X-Xss-Protection=1; mode=block Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=18979573B0386477 Date=Wed, 25 Feb 2026 19:55:02 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=iGNQhXTcysT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/694db9520754bed3
FAIL (2026-02-25 19:55:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18979573B0386477</RequestId><HostId></HostId></Error>"
Duration: 9.009131ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................XX...] duration:
435.629584ms trace:
https://jaeger.dev.storj.io/trace/56af7b4e02fced30
FAIL (2026-02-25 19:54:44 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 435.651425ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
905.052931ms trace:
https://jaeger.dev.storj.io/trace/666feae5ab81832a
FAIL (2026-02-25 19:54:37 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 905.072969ms
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.729694ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=1897956C4930A78B X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 X-Request-Id=2LZ5Xge1n2N Date=Wed, 25 Feb 2026 19:54:30 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/27a3ca8c4a43bd5d
FAIL (2026-02-25 19:54:30 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897956C4930A78B</RequestId><HostId></HostId></Error>"
Duration: 23.74893ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
14.541868ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=1897956B612D9093 X-Request-Id=R3rtx6A4nP4 X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:54:26 GMT Accept-Ranges=bytes Server=Storj target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3de425b1be927226
FAIL (2026-02-25 19:54:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897956B612D9093</RequestId><HostId></HostId></Error>"
Duration: 14.588435ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
42.247268ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Date=Wed, 25 Feb 2026 19:54:26 GMT Content-Length=274 Content-Type=application/xml Server=Storj X-Request-Id=ckEzvw6aP5h Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1897956B5DC1FB64 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/618f8bd40cdaf99f
FAIL (2026-02-25 19:54:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897956B5DC1FB64</RequestId><HostId></HostId></Error>"
Duration: 42.262827ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.23852789s trace:
https://jaeger.dev.storj.io/trace/1fe01af1829f0be1
FAIL (2026-02-25 19:54:21 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421454648 (191h44m38.560438832s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421578089 (191h44m38.560562283s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421728089 (191h44m38.560712283s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422017611 (191h44m38.561001805s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422060290 (191h44m38.561044474s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422282916 (191h44m38.56126711s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422655902 (191h44m38.561640086s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422837041 (191h44m38.561821235s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.423092007 (191h44m38.562076201s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.430566942 (191h44m38.569551137s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.432103813 (191h44m38.571088007s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.893905905 (191h44m39.03289012s) [upload=168595]: Next returned nil segment
Feb 25 19:53:19.893924289 (191h44m39.032908513s) [upload=168595]: Waiting for error group managing segments...
Feb 25 19:53:20.057105011 (191h44m39.196089225s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.062110133 (191h44m39.201094346s) [noise=true , address=81.171.14.70:4038 , piece_id=NWGOFS3B24NHEYMRDL33LDA3YD6XACUW2CMLFG74B2WN55R6A73A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.077016472 (191h44m39.216000685s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.080640101 (191h44m39.219624315s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.081710791 (191h44m39.220695005s) [noise=true , address=81.171.14.70:4043 , piece_id=XDBJJZDEKYV4KILNC5NDYZXHYCPC5JI6DSIH3Q3FMGP334FYNLOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.082415427 (191h44m39.221399641s) [noise=true , address=185.167.204.206:4063 , piece_id=JRIRXSJPQUOVZYQ2VOVBRLSHFEV52LFYCFKY3SI3KKS4O247CMFQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.089072265 (191h44m39.228056478s) [noise=true , address=81.171.14.70:4045 , piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.093745155 (191h44m39.232729369s) [noise=true , address=185.167.204.206:4058 , piece_id=TEDZH2KKMZBASS7XSWFOPZ6BZUAQAJ6U6NMFZXKSDEBGO3SMNJZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.099158497 (191h44m39.238142711s) [noise=true , address=185.167.204.206:4054 , piece_id=RWM25MOHLCPVNATEGKYJJVA6CJJNMBZ2MUNX7C5SQ7YWPBXFEVRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.106839228 (191h44m39.245823441s) [noise=true , address=185.167.204.206:4071 , piece_id=X7R4LXHTJ4EVUXGRA5UXDFIYKSD7QUYWESFPFVJWPZJ3PZDVATVA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.108375808 (191h44m39.247360022s) [noise=true , address=81.171.14.70:4040 , piece_id=2J7EQDG4GFWYIT6Z4NWWO3L56SRPRYP6U3LG4AUDUSFKGAOJOBWQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.110162726 (191h44m39.249146951s) [noise=true , address=81.171.14.70:4028 , piece_id=MPDDEJYIQUB5R3QWOHYENYGLYB4SKQOT2Z672FACWY76SKWEWD5A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.111590173 (191h44m39.250574387s) [noise=true , address=185.167.204.206:4055 , piece_id=OGHPESIQ3JCZZ7SV4HX4HN3RSLX3FUNLEPR7Y3KWNJJHYAQGK7ZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.115647433 (191h44m39.254631647s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.118635516 (191h44m39.25761972s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.121613028 (191h44m39.260597242s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.123704996 (191h44m39.262689211s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.127728924 (191h44m39.266713138s) [noise=true , address=185.167.204.205:4017 , piece_id=4WSZ7UHHQXRAYRGK63YKHVQJHKLC2ZUTR5W7XDN5V5Y7NZU3HBXQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.129742255 (191h44m39.268726469s) [noise=true , address=185.167.204.205:4034 , piece_id=SY7S5CSR4LDXAK3JEHZ6TGLKQDRY5ER6YHSCQALW7DT633ADEJUQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.147042467 (191h44m39.286026682s) [noise=true , address=185.167.204.205:4019 , piece_id=2GZCP5TFIWEC77KK4JAQ457FOUVHRPMZEXWIUHZPYMJYQ7SALFOQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.621082182 (191h44m40.760066396s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.693787103 (191h44m40.832771328s) [noise=true , address=89.149.201.147:4015 , piece_id=PX2G72RYQAG3XBJ4EQURYGAWN4PTGUDEUYUMEIM7STT34T5GDACA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:22.075335713 (191h44m41.214319927s) [noise=true , address=89.149.201.147:4021 , piece_id=CEUFYFFN77WRGMNYALBS2EKXEBLK4WNGSN3VJOHNNPMQTZ7CB5WQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:09.191329363 (191h45m28.330313576s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:10.362985909 (191h45m29.501970133s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:19.003151394 (191h45m38.142135638s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF
Feb 25 19:54:19.003245480 (191h45m38.142229674s) [noise=true , address=89.149.201.147:4017 , piece_id=BVJ3PP3DIKR4VJV745R6LFOODFUB53VHUNZVW7MPDPEXIKD26T5Q, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection
Feb 25 19:54:19.003265587 (191h45m38.142249781s) [noise=true , address=89.149.201.147:4024 , piece_id=AKKZHIKUR6XKQKLDRPVRUAKUSUWPD3DW4CJXM6OAO7OMMY54TWZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 5.161.89.252:21760->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 19:54:19.003283972 (191h45m38.142268166s) [seg_pos={0 0}, upload=168595]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 25 19:54:19.113672385 (191h45m38.252656599s) [upload=168595]: Done uploading segments...
Feb 25 19:54:19.113718592 (191h45m38.252702845s) [upload=168595]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.238547697s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.114790277s trace:
https://jaeger.dev.storj.io/trace/1fe01af1829f0be1
FAIL (2026-02-25 19:54:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421454648 (191h44m38.560438832s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421578089 (191h44m38.560562283s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.421728089 (191h44m38.560712283s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422017611 (191h44m38.561001805s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422060290 (191h44m38.561044474s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422282916 (191h44m38.56126711s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422655902 (191h44m38.561640086s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.422837041 (191h44m38.561821235s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.423092007 (191h44m38.562076201s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.430566942 (191h44m38.569551137s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.432103813 (191h44m38.571088007s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Uploading piece...
Feb 25 19:53:19.893905905 (191h44m39.03289012s) [upload=168595]: Next returned nil segment
Feb 25 19:53:19.893924289 (191h44m39.032908513s) [upload=168595]: Waiting for error group managing segments...
Feb 25 19:53:20.057105011 (191h44m39.196089225s) [noise=true , address=81.171.14.70:4035 , piece_id=AMPWW56OP42TKIZACXFNXZ2KEFZLFAL4GKFPWUTWQHSJAUQV7XOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.062110133 (191h44m39.201094346s) [noise=true , address=81.171.14.70:4038 , piece_id=NWGOFS3B24NHEYMRDL33LDA3YD6XACUW2CMLFG74B2WN55R6A73A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.077016472 (191h44m39.216000685s) [noise=true , address=185.167.204.206:4048 , piece_id=U557WNLPPUT5P3ATRR22RDSP3WA4DQ5ASYQR3RGWLZDLYA65CIQA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.080640101 (191h44m39.219624315s) [noise=true , address=81.171.14.70:4031 , piece_id=RZA3KI5EBJZHYWIVOINVOR4RHXUYAYXCHJSFO5URPMEWO6DGXHGQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.081710791 (191h44m39.220695005s) [noise=true , address=81.171.14.70:4043 , piece_id=XDBJJZDEKYV4KILNC5NDYZXHYCPC5JI6DSIH3Q3FMGP334FYNLOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.082415427 (191h44m39.221399641s) [noise=true , address=185.167.204.206:4063 , piece_id=JRIRXSJPQUOVZYQ2VOVBRLSHFEV52LFYCFKY3SI3KKS4O247CMFQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.089072265 (191h44m39.228056478s) [noise=true , address=81.171.14.70:4045 , piece_id=JSDVF2TMTNCHOOYA7YHBR5LVBS63OSB4USPEOOI7JT4VHDWDUKRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.093745155 (191h44m39.232729369s) [noise=true , address=185.167.204.206:4058 , piece_id=TEDZH2KKMZBASS7XSWFOPZ6BZUAQAJ6U6NMFZXKSDEBGO3SMNJZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.099158497 (191h44m39.238142711s) [noise=true , address=185.167.204.206:4054 , piece_id=RWM25MOHLCPVNATEGKYJJVA6CJJNMBZ2MUNX7C5SQ7YWPBXFEVRA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.106839228 (191h44m39.245823441s) [noise=true , address=185.167.204.206:4071 , piece_id=X7R4LXHTJ4EVUXGRA5UXDFIYKSD7QUYWESFPFVJWPZJ3PZDVATVA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.108375808 (191h44m39.247360022s) [noise=true , address=81.171.14.70:4040 , piece_id=2J7EQDG4GFWYIT6Z4NWWO3L56SRPRYP6U3LG4AUDUSFKGAOJOBWQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.110162726 (191h44m39.249146951s) [noise=true , address=81.171.14.70:4028 , piece_id=MPDDEJYIQUB5R3QWOHYENYGLYB4SKQOT2Z672FACWY76SKWEWD5A, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.111590173 (191h44m39.250574387s) [noise=true , address=185.167.204.206:4055 , piece_id=OGHPESIQ3JCZZ7SV4HX4HN3RSLX3FUNLEPR7Y3KWNJJHYAQGK7ZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.115647433 (191h44m39.254631647s) [noise=true , address=81.171.14.70:4039 , piece_id=IIXZE6VKSR3GU52NTXX7SVJTA2EFEQD4YYNHGTE42D7TPWPFQECA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.118635516 (191h44m39.25761972s) [noise=true , address=185.167.204.205:4007 , piece_id=ZQGH5GD7WXW64OHZ4SP7K3QWVOGJU724OLCJPH4VARXWDSBZVCOA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.121613028 (191h44m39.260597242s) [noise=true , address=185.167.204.206:4061 , piece_id=UVYUI2MPCWY2C5A3VWYRUU4PDTMGK4SBYB7WJOEXSPZ2YLLKSCIA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.123704996 (191h44m39.262689211s) [noise=true , address=185.167.204.205:4033 , piece_id=QO2VBT3MLN7Z2IRDFL73QF6MY5KVRIQT4RIDK25HNANI4UFYVTIQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.127728924 (191h44m39.266713138s) [noise=true , address=185.167.204.205:4017 , piece_id=4WSZ7UHHQXRAYRGK63YKHVQJHKLC2ZUTR5W7XDN5V5Y7NZU3HBXQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.129742255 (191h44m39.268726469s) [noise=true , address=185.167.204.205:4034 , piece_id=SY7S5CSR4LDXAK3JEHZ6TGLKQDRY5ER6YHSCQALW7DT633ADEJUQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:20.147042467 (191h44m39.286026682s) [noise=true , address=185.167.204.205:4019 , piece_id=2GZCP5TFIWEC77KK4JAQ457FOUVHRPMZEXWIUHZPYMJYQ7SALFOQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.621082182 (191h44m40.760066396s) [noise=true , address=89.149.201.147:4007 , piece_id=72MPWJVDYNCCIU7IDTGOB3WSLUTF63MQFV3Q65UV2JMYSVWHFKVQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:21.693787103 (191h44m40.832771328s) [noise=true , address=89.149.201.147:4015 , piece_id=PX2G72RYQAG3XBJ4EQURYGAWN4PTGUDEUYUMEIM7STT34T5GDACA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:53:22.075335713 (191h44m41.214319927s) [noise=true , address=89.149.201.147:4021 , piece_id=CEUFYFFN77WRGMNYALBS2EKXEBLK4WNGSN3VJOHNNPMQTZ7CB5WQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:09.191329363 (191h45m28.330313576s) [noise=true , address=89.149.201.147:4022 , piece_id=WW3AX4NFOW5HNBOBM3MDKFKGACEAMHKGICMC57ID6AL5BOAG5WNA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:10.362985909 (191h45m29.501970133s) [noise=true , address=89.149.201.147:4012 , piece_id=PO5EGW7TPGK5K26KL3DOFQ7ACUNTIZOSLXCHBCDHEXWDQPZVQCLA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: <nil>
Feb 25 19:54:19.003151394 (191h45m38.142135638s) [noise=true , address=89.149.201.147:4001 , piece_id=AYGBYJWPZCPKDMSYYLQW7YUHDBG2S6ZMH4LYIXGHMCAFP6PMJGMA, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: expected piece hash; context deadline exceeded; EOF
Feb 25 19:54:19.003245480 (191h45m38.142229674s) [noise=true , address=89.149.201.147:4017 , piece_id=BVJ3PP3DIKR4VJV745R6LFOODFUB53VHUNZVW7MPDPEXIKD26T5Q, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ, address:89.149.201.147:4017): protocol: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:60820->89.149.201.147:4017: use of closed network connection
Feb 25 19:54:19.003265587 (191h45m38.142249781s) [noise=true , address=89.149.201.147:4024 , piece_id=AKKZHIKUR6XKQKLDRPVRUAKUSUWPD3DW4CJXM6OAO7OMMY54TWZQ, seg_pos={0 0}, upload=168595]: Done uploading piece. err: ecclient: upload failed (node:12r2sAmG1Xa83zRjY96g1Ro6dfDUHvKkqdCtFYoeviKcUJsAMBT, address:89.149.201.147:4024): protocol: read tcp 5.161.89.252:21760->89.149.201.147:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 25 19:54:19.003283972 (191h45m38.142268166s) [seg_pos={0 0}, upload=168595]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Feb 25 19:54:19.113672385 (191h45m38.252656599s) [upload=168595]: Done uploading segments...
Feb 25 19:54:19.113718592 (191h45m38.252702845s) [upload=168595]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.114843206s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
930.751768ms trace:
https://jaeger.dev.storj.io/trace/666feae5ab81832a
FAIL (2026-02-25 19:54:14 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 930.772828ms
core
uplink
eu1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X.X............XX......................................] duration:
3.292897377s trace:
https://jaeger.dev.storj.io/trace/351ddb90b1764fd3
FAIL (2026-02-25 19:54:13 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.292969752s
core
uplink
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.836691ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj X-Amz-Request-Id=189795656FF406AA X-Request-Id=HArZBpsMKfN X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Vary=Origin Date=Wed, 25 Feb 2026 19:54:01 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/6035380c011bfea9
FAIL (2026-02-25 19:54:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189795656FF406AA</RequestId><HostId></HostId></Error>"
Duration: 24.860395ms
edge
gateway
vhost
bgp
eu1
|