Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 665168 reports (Page 10043 of 13304)
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
25.434728ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
X-Amz-Request-Id=1897417527A21368
X-Request-Id=XNNm55EmB63
Date=Tue, 24 Feb 2026 18:15:49 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/511603683a1407a1
FAIL (2026-02-24 18:15:49 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897417527A21368</RequestId><HostId></HostId></Error>"
Duration: 25.457882ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
1m0.001539177s
trace:
https://jaeger.dev.storj.io/trace/119f2bd0f03eceb4
FAIL (2026-02-24 18:15:46 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001557862s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration:
30.002126434s
trace:
https://jaeger.dev.storj.io/trace/21e2b65806e8c0bd
FAIL (2026-02-24 18:15:45 UTC)
operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 30.002144388s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
1m0.001834529s
trace:
https://jaeger.dev.storj.io/trace/5a9e2e3249c37545
FAIL (2026-02-24 18:15:44 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:14:44.035429420 (166h6m3.174413635s) [upload=146121]: Starting upload
Feb 24 18:14:44.035521664 (166h6m3.174505877s) [upload=146121]: Done starting upload
Feb 24 18:14:44.035556908 (166h6m3.174541133s) [upload=146121]: Uploading segments...
Feb 24 18:14:44.035888959 (166h6m3.174873174s) [upload=146121]: Got next segment. Inline: false
Feb 24 18:14:44.035970061 (166h6m3.174954275s) [upload=146121]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:14:44.035976533 (166h6m3.174960748s) [upload=146121]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:15:44.020946093 (166h7m3.159930308s) [upload=146121]: Next segment err: context deadline exceeded
Feb 24 18:15:44.021288384 (166h7m3.160272607s) [upload=146121]: Done uploading segments...
Feb 24 18:15:44.021338617 (166h7m3.160322832s) [upload=146121]: Upload finished. err: context deadline exceeded
Duration: 1m0.001848986s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
23.023824ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=1897417407980DB2
X-Xss-Protection=1; mode=block
Content-Length=274
Content-Type=application/xml
Vary=Origin
X-Request-Id=5fwpSp9Ve9B
Date=Tue, 24 Feb 2026 18:15:44 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/6beab8dababcf1ef
FAIL (2026-02-24 18:15:44 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897417407980DB2</RequestId><HostId></HostId></Error>"
Duration: 23.040106ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration:
30.001233005s
trace:
https://jaeger.dev.storj.io/trace/2f4d1111473d35e4
FAIL (2026-02-24 18:15:42 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:15:12.306373823 (166h6m31.445358017s) [upload=146128]: Starting upload
Feb 24 18:15:12.306429587 (166h6m31.445413772s) [upload=146128]: Done starting upload
Feb 24 18:15:12.306494269 (166h6m31.445478463s) [upload=146128]: Uploading segments...
Feb 24 18:15:12.306666880 (166h6m31.445651074s) [upload=146128]: Got next segment. Inline: false
Feb 24 18:15:12.306696686 (166h6m31.44568087s) [upload=146128]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:15:12.306700543 (166h6m31.445684737s) [upload=146128]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:15:42.291040216 (166h7m1.43002443s) [upload=146128]: Next segment err: context deadline exceeded
Feb 24 18:15:42.291407612 (166h7m1.430391827s) [upload=146128]: Done uploading segments...
Feb 24 18:15:42.291460982 (166h7m1.430445197s) [upload=146128]: Upload finished. err: context deadline exceeded
Duration: 30.001249785s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
1m0.001470189s
trace:
https://jaeger.dev.storj.io/trace/6ebdb6482a422500
FAIL (2026-02-24 18:15:38 UTC)
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:14:38.770955812 (166h5m57.909940006s) [upload=146120]: Starting upload
Feb 24 18:14:38.770995686 (166h5m57.909979871s) [upload=146120]: Done starting upload
Feb 24 18:14:38.771038887 (166h5m57.910023082s) [upload=146120]: Uploading segments...
Feb 24 18:14:38.771067139 (166h5m57.910051324s) [upload=146120]: Got next segment. Inline: true
Feb 24 18:14:38.771070666 (166h5m57.91005486s) [upload=146120]: Waiting for error group managing segments...
Feb 24 18:14:38.771111373 (166h5m57.910095567s) [upload=146120]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:14:38.771115069 (166h5m57.910099263s) [upload=146120]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:14:38.771117544 (166h5m57.910101738s) [upload=146120]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:15:38.758100086 (166h6m57.897084271s) [upload=146120]: Done uploading segments...
Feb 24 18:15:38.758139129 (166h6m57.897123313s) [upload=146120]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.001479897s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
39.497761ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:15:37 GMT
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=189741725331843F
X-Request-Id=REKiHNagewu
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/17b5d375c76a59d1
FAIL (2026-02-24 18:15:37 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189741725331843F</RequestId><HostId></HostId></Error>"
Duration: 39.526967ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration:
30.001862043s
trace:
https://jaeger.dev.storj.io/trace/720f8308d7740f51
FAIL (2026-02-24 18:15:35 UTC)
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:15:05.387736563 (166h6m24.526720777s) [upload=146126]: Starting upload
Feb 24 18:15:05.387827704 (166h6m24.526811918s) [upload=146126]: Done starting upload
Feb 24 18:15:05.387975419 (166h6m24.526959634s) [upload=146126]: Uploading segments...
Feb 24 18:15:05.388037946 (166h6m24.52702216s) [upload=146126]: Got next segment. Inline: true
Feb 24 18:15:05.388044317 (166h6m24.527028532s) [upload=146126]: Waiting for error group managing segments...
Feb 24 18:15:05.388094852 (166h6m24.527079077s) [upload=146126]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:15:05.388101365 (166h6m24.527085579s) [upload=146126]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:15:05.388105222 (166h6m24.527089436s) [upload=146126]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:15:35.369529912 (166h6m54.508514137s) [upload=146126]: Done uploading segments...
Feb 24 18:15:35.369710149 (166h6m54.508694353s) [upload=146126]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.001883643s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..]
duration:
547.913668ms
trace:
https://jaeger.dev.storj.io/trace/74a421320e9af30f
FAIL (2026-02-24 18:15:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 547.934156ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
7.447243ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=189741711D8EF1E2
Date=Tue, 24 Feb 2026 18:15:32 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Vary=Origin
X-Request-Id=epBYRpajYPd
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/1fae3ea260623d22
FAIL (2026-02-24 18:15:32 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189741711D8EF1E2</RequestId><HostId></HostId></Error>"
Duration: 7.463985ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
5 out of 60 is failed (threshold=3) [.......................................................XXXXX]
duration:
30.000603631s
trace:
https://jaeger.dev.storj.io/trace/d0b81c77d89f6b8
FAIL (2026-02-24 18:15:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000620954s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration:
30.001527675s
trace:
https://jaeger.dev.storj.io/trace/566f7c759b348c2c
FAIL (2026-02-24 18:15:14 UTC)
operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 30.001538565s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................]
duration:
2.217255619s
trace:
https://jaeger.dev.storj.io/trace/24b4edf9256675dc
FAIL (2026-02-24 18:15:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
7EICWCWMEABP3ENF5Q, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.249727323 (165h26m16.388711507s) [noise=true , address=81.171.14.70:4036    , piece_id=N4AIPU6IKD3HPSXHROJSWHFLAN573JOD6W6TUTV6FZQEMWVYCSHA, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250011063 (165h26m16.388995257s) [noise=true , address=185.167.204.206:4070 , piece_id=OQP5Z7ZJ3K76NJK3QSMAZEJTI6HFT7FUHT5E5IXAX4RJLHMB4I7A, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250290094 (165h26m16.389274278s) [noise=true , address=185.167.204.206:4056 , piece_id=YJJKP7ZHN6XESSLSHRTNWBCVU7ZLDNPQUUPE7V2ZMOLR4UJ2WX5Q, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250587089 (165h26m16.389571283s) [noise=true , address=185.167.204.205:4026 , piece_id=JMBMNNNQGEPQ5I5PGG6ZLNP2SAJEOPXM3KVTB6NMVYBVTBU27I2Q, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250850792 (165h26m16.389834976s) [noise=true , address=81.171.14.70:4030    , piece_id=B4LMP6JJEI7KFLUTDP4LTLX3DKB6EJASZLQLHXX4PHXOYDW6V2LA, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.724619104 (165h26m16.863603319s) [upload=145547]: Next returned nil segment
Feb 24 17:34:57.724631829 (165h26m16.863616042s) [upload=145547]: Waiting for error group managing segments...
Feb 24 17:34:57.901571686 (165h26m17.04055587s) [noise=true , address=89.149.201.147:4011  , piece_id=UYS6AJGSLDCVZ2R2YYZQP7W7S3RNKGW5RPPPCATQGULFW6HS7HDQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.908951002 (165h26m17.047935196s) [noise=true , address=89.149.201.147:4012  , piece_id=TSXMBWUIWR4S3CGSTJF6Y35EM22QFYSOB3HLGBV7LBZW4MKV7QFQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.915198182 (165h26m17.054182396s) [noise=true , address=185.167.204.205:4026 , piece_id=JMBMNNNQGEPQ5I5PGG6ZLNP2SAJEOPXM3KVTB6NMVYBVTBU27I2Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.915867082 (165h26m17.054851295s) [noise=true , address=185.167.204.205:4027 , piece_id=7AKTJIIAHEOOP3BNPWH4TB7ISZO7G6UM3JPYQLOF3MATWPZOEPCA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.916644374 (165h26m17.055628588s) [noise=true , address=185.167.204.205:4036 , piece_id=5UFBMTYMSM5VCPXZISA7PLK3B6WPTEHVTRIPMAUTEIFQ5CDRBQVQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.917614386 (165h26m17.0565986s) [noise=true , address=89.149.201.147:4023  , piece_id=NXX5UHIY23R5NVUM3QEMMFHYUVYFRRMLBZNUVELN3ZTAJSTCGUHA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.933365171 (165h26m17.072349365s) [noise=true , address=89.149.201.147:4014  , piece_id=IUSO2AFUBTVD4RUQXBY7GMLF6QX6U5UPS6J34Y2ZHSXMK4BK3WUA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.938423079 (165h26m17.077407294s) [noise=true , address=185.167.204.205:4004 , piece_id=O3OFG2BPNLEWVLL2FSPTDOKKVT7FUBEIISOWVRI7VD2ZDR5PBVNQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.964706541 (165h26m17.103690755s) [noise=true , address=185.167.204.206:4069 , piece_id=XAOTFHYPCHWOXE67HR5EB56FICFCTBGEOVE7KVSQV2FQ2NWDNKWA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.965170328 (165h26m17.104154512s) [noise=true , address=185.167.204.205:4012 , piece_id=Q5JTWCNRG4SBMAE4YCJKJHGDQPE7AOINO2LRLBRGXW5O36OB5WVA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.971952097 (165h26m17.11093631s) [noise=true , address=185.167.204.206:4053 , piece_id=O6BLFT5UE3IEWSHAAUTGYTBINPYSWFBTLWC4TYPW3XN5VPLBDKRQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.972322990 (165h26m17.111307173s) [noise=true , address=185.167.204.206:4066 , piece_id=5FVO2YQGZV2WOAZ7T5H3LNJUNXXMK55OCZENG35DFEEWBLA5N5GQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.975251300 (165h26m17.114235483s) [noise=true , address=185.167.204.206:4041 , piece_id=DDMUQAEF7JPW6FR6LYCWH3AWY5HF4SA7IQCBOOKHOFAVZLWE23DQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.980987377 (165h26m17.11997159s) [noise=true , address=185.167.204.206:4070 , piece_id=OQP5Z7ZJ3K76NJK3QSMAZEJTI6HFT7FUHT5E5IXAX4RJLHMB4I7A, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.983946945 (165h26m17.122931129s) [noise=true , address=185.167.204.206:4056 , piece_id=YJJKP7ZHN6XESSLSHRTNWBCVU7ZLDNPQUUPE7V2ZMOLR4UJ2WX5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.989584816 (165h26m17.128569041s) [noise=true , address=89.149.201.147:4018  , piece_id=OEQOZB5IRSIY5CR5UJ5XXMZPDGH4XN6KQ7ZGCZMBYNBX6OSMOKQQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.995870059 (165h26m17.134854243s) [noise=true , address=89.149.201.147:4013  , piece_id=R6HK4UBOGRHIEOHSJJA7DRSVDRNF27QW4Z7EICWCWMEABP3ENF5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:49.889621672 (165h27m9.028605886s) [noise=true , address=81.171.14.70:4036    , piece_id=N4AIPU6IKD3HPSXHROJSWHFLAN573JOD6W6TUTV6FZQEMWVYCSHA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:50.581661013 (165h27m9.720645197s) [noise=true , address=81.171.14.70:4034    , piece_id=2B3TO6XY2NVRX5SQ5SUW6OEMLWZHYNPWHOHBL5EAWM2PEDV4KHHQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:53.182181244 (165h27m12.321165459s) [noise=true , address=81.171.14.70:4033    , piece_id=H6ZB652A5CNAUCNLXHRMXJKXRNBK2HGWENUY3AKCRSWMK2IHE3AA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:55.084212904 (165h27m14.223197098s) [noise=true , address=81.171.14.70:4041    , piece_id=XGTKMITYQPT67CNFDJJGZW3TWFNIFGMGZYBBV7RDGNSPJGBBKX5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:56.826408639 (165h27m15.965392853s) [noise=true , address=81.171.14.70:4047    , piece_id=SLTCRDUZZ74TF7UUKKA3ZW4DV4RO7VO7CW37RZ3KOTXCPNEBWVAQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 5.161.89.252:51760->81.171.14.70:4047: use of closed network connection; write tcp 5.161.89.252:51760->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:51760->81.171.14.70:4047: use of closed network connection
Feb 24 17:35:56.826540285 (165h27m15.965524498s) [noise=true , address=81.171.14.70:4037    , piece_id=Z7IPSTK2E3WQ6RPTB43HFST52BECH7VRHLKPV6V5FWOMJ7YNWFCA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 5.161.89.252:61326->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 17:35:56.826589036 (165h27m15.96557326s) [noise=true , address=81.171.14.70:4030    , piece_id=B4LMP6JJEI7KFLUTDP4LTLX3DKB6EJASZLQLHXX4PHXOYDW6V2LA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 5.161.89.252:54788->81.171.14.70:4030: use of closed network connection; write tcp 5.161.89.252:54788->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54788->81.171.14.70:4030: use of closed network connection
Feb 24 17:35:56.826781545 (165h27m15.965765759s) [noise=true , address=81.171.14.70:4042    , piece_id=FP4T4TB3C5K2HORTY55FWKP4AQYJYTT3AIQE5ERTDG6IVEKLXB6Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: read tcp 5.161.89.252:16670->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 17:35:56.826879228 (165h27m15.965863452s) [noise=true , address=81.171.14.70:4048    , piece_id=S5QG4SXCIEBZAJCPNY3GYLWO3OA3LXPMGDZWLIVTJMC5WZ7MIT5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF
Feb 24 17:35:56.827059424 (165h27m15.966043638s) [noise=true , address=81.171.14.70:4046    , piece_id=ROYQDMKWPNWJWK2ZXNO46P75STGAHHN7OHTR2ABQNBGCCYKTABQQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 5.161.89.252:12860->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 17:35:56.827234200 (165h27m15.966218415s) [noise=true , address=81.171.14.70:4029    , piece_id=ANBM4PEUW4YPPXUYUB2VAKXMDBEXBD7CO42CXEHAJ2W5NDNXL4WQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:10314->81.171.14.70:4029: use of closed network connection; write tcp 5.161.89.252:10314->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:10314->81.171.14.70:4029: use of closed network connection
Feb 24 17:35:56.827285327 (165h27m15.966269551s) [seg_pos={0 0}, upload=145547]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Feb 24 17:35:56.937070410 (165h27m16.076054634s) [upload=145547]: Done uploading segments...
Feb 24 17:35:56.937143686 (165h27m16.076127911s) [upload=145547]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 2.217276327s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
16.302347ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Length=284
X-Amz-Request-Id=1897416B7ABFE67E
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Request-Id=aUKEodRGkKp
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:15:08 GMT
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/6eab72294ad66185
FAIL (2026-02-24 18:15:08 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897416B7ABFE67E</RequestId><HostId></HostId></Error>"
Duration: 16.312897ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.000826044s
trace:
https://jaeger.dev.storj.io/trace/5332049e9a5e7df0
FAIL (2026-02-24 18:15:03 UTC)
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:14:33.824602645 (166h5m52.963586859s) [upload=146118]: Starting upload
Feb 24 18:14:33.824669851 (166h5m52.963654065s) [upload=146118]: Done starting upload
Feb 24 18:14:33.824792751 (166h5m52.963776975s) [upload=146118]: Uploading segments...
Feb 24 18:14:33.825111427 (166h5m52.96409564s) [upload=146118]: Got next segment. Inline: false
Feb 24 18:14:33.825158555 (166h5m52.964142769s) [upload=146118]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:14:33.825165797 (166h5m52.964150012s) [upload=146118]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:15:03.808712923 (166h6m22.947697118s) [upload=146118]: Next segment err: context deadline exceeded
Feb 24 18:15:03.808963191 (166h6m22.947947385s) [upload=146118]: Done uploading segments...
Feb 24 18:15:03.809027631 (166h6m22.948011804s) [upload=146118]: Upload finished. err: context deadline exceeded
Duration: 30.000840752s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.000532174s
trace:
https://jaeger.dev.storj.io/trace/1bcc0eb32fbd359f
FAIL (2026-02-24 18:15:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000553544s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.001301278s
trace:
https://jaeger.dev.storj.io/trace/15028c6ce3371ef6
FAIL (2026-02-24 18:14:44 UTC)
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:14:14.633085276 (166h5m33.77206947s) [upload=146116]: Starting upload
Feb 24 18:14:14.633135078 (166h5m33.772119272s) [upload=146116]: Done starting upload
Feb 24 18:14:14.633176916 (166h5m33.77216109s) [upload=146116]: Uploading segments...
Feb 24 18:14:14.633224084 (166h5m33.772208268s) [upload=146116]: Got next segment. Inline: true
Feb 24 18:14:14.633228112 (166h5m33.772212296s) [upload=146116]: Waiting for error group managing segments...
Feb 24 18:14:14.633268748 (166h5m33.772252933s) [upload=146116]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:14:14.633273227 (166h5m33.77225741s) [upload=146116]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:14:14.633275581 (166h5m33.772259755s) [upload=146116]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:14:44.621657264 (166h6m3.760641448s) [upload=146116]: Done uploading segments...
Feb 24 18:14:44.621679485 (166h6m3.760663669s) [upload=146116]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.001310094s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.000598794s
trace:
https://jaeger.dev.storj.io/trace/2ea858f9176e3c9d
FAIL (2026-02-24 18:14:44 UTC)
operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 30.000610826s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
24.797889ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Amz-Request-Id=18974165F7786EC2
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:14:44 GMT
Content-Type=application/xml
X-Request-Id=LkfECQWGWG5
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/3180d883541e5bf6
FAIL (2026-02-24 18:14:44 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974165F7786EC2</RequestId><HostId></HostId></Error>"
Duration: 24.820612ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
1m0.001691817s
trace:
https://jaeger.dev.storj.io/trace/ec49b7be69e96c0
FAIL (2026-02-24 18:14:43 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:13:43.973032617 (166h5m3.112016801s) [upload=146107]: Starting upload
Feb 24 18:13:43.973117044 (166h5m3.112101258s) [upload=146107]: Done starting upload
Feb 24 18:13:43.973165835 (166h5m3.11215005s) [upload=146107]: Uploading segments...
Feb 24 18:13:43.973421593 (166h5m3.112405777s) [upload=146107]: Got next segment. Inline: false
Feb 24 18:13:43.973461769 (166h5m3.112445963s) [upload=146107]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:13:43.973465776 (166h5m3.11244996s) [upload=146107]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:14:43.955092018 (166h6m3.094076233s) [upload=146107]: Next segment err: context deadline exceeded
Feb 24 18:14:43.955429700 (166h6m3.094413924s) [upload=146107]: Done uploading segments...
Feb 24 18:14:43.955480505 (166h6m3.094464719s) [upload=146107]: Upload finished. err: context deadline exceeded
Duration: 1m0.001703451s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
23.927694ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=18974165CC4BB9D5
Date=Tue, 24 Feb 2026 18:14:43 GMT
X-Request-Id=ChhRy4FZhsT
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/35af8a4002ad450f
FAIL (2026-02-24 18:14:43 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974165CC4BB9D5</RequestId><HostId></HostId></Error>"
Duration: 23.949004ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration:
30.001637057s
trace:
https://jaeger.dev.storj.io/trace/1edecbec0aeb7315
FAIL (2026-02-24 18:14:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001660262s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
27.034628ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
X-Request-Id=2JazLKyCAmn
Accept-Ranges=bytes
Content-Type=application/xml
X-Amz-Request-Id=18974164E4EFBBEA
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:14:39 GMT
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/21f4fa76e6548437
FAIL (2026-02-24 18:14:39 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974164E4EFBBEA</RequestId><HostId></HostId></Error>"
Duration: 27.054585ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
1m0.000658028s
trace:
https://jaeger.dev.storj.io/trace/11726067fda6e553
FAIL (2026-02-24 18:14:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000676423s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
1m0.001139436s
trace:
https://jaeger.dev.storj.io/trace/5642b10ca89ca2cb
FAIL (2026-02-24 18:14:38 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:13:38.707318741 (166h4m57.846302935s) [upload=146105]: Starting upload
Feb 24 18:13:38.707391507 (166h4m57.84637569s) [upload=146105]: Done starting upload
Feb 24 18:13:38.707413869 (166h4m57.846398063s) [upload=146105]: Uploading segments...
Feb 24 18:13:38.707465526 (166h4m57.846449709s) [upload=146105]: Got next segment. Inline: true
Feb 24 18:13:38.707470375 (166h4m57.846454558s) [upload=146105]: Waiting for error group managing segments...
Feb 24 18:13:38.707513645 (166h4m57.846497839s) [upload=146105]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:13:38.707517683 (166h4m57.846501867s) [upload=146105]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:13:38.707520198 (166h4m57.846504392s) [upload=146105]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:14:38.695383573 (166h5m57.834367787s) [upload=146105]: Done uploading segments...
Feb 24 18:14:38.695423046 (166h5m57.83440725s) [upload=146105]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.001151299s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.001707612s
trace:
https://jaeger.dev.storj.io/trace/72c0fd231983dfca
FAIL (2026-02-24 18:14:33 UTC)
operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 30.001730223s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.]
duration:
466.88509ms
trace:
https://jaeger.dev.storj.io/trace/74a421320e9af30f
FAIL (2026-02-24 18:14:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 466.91212ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X]
duration:
2m0.001175972s
remote:
"tcp:136.0.77.4:443"
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/73ffb68f0fd921f
FAIL (2026-02-24 18:14:19 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 2m0.001198194s edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
30.001393355s
trace:
https://jaeger.dev.storj.io/trace/5fd05df38576fcb7
FAIL (2026-02-24 18:14:18 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:13:48.991128862 (166h5m8.130113066s) [upload=146109]: Starting upload
Feb 24 18:13:48.991179876 (166h5m8.13016408s) [upload=146109]: Done starting upload
Feb 24 18:13:48.991349424 (166h5m8.130333637s) [upload=146109]: Uploading segments...
Feb 24 18:13:48.991472713 (166h5m8.130456907s) [upload=146109]: Got next segment. Inline: false
Feb 24 18:13:48.991531975 (166h5m8.130516188s) [upload=146109]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:13:48.991539599 (166h5m8.130523813s) [upload=146109]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:14:18.978403900 (166h5m38.117388104s) [upload=146109]: Next segment err: context deadline exceeded
Feb 24 18:14:18.978735560 (166h5m38.117719764s) [upload=146109]: Done uploading segments...
Feb 24 18:14:18.978778720 (166h5m38.117762923s) [upload=146109]: Upload finished. err: context deadline exceeded
Duration: 30.00141181s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
11.219659ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
Content-Length=284
Content-Type=application/xml
X-Amz-Request-Id=1897415E4058B2D7
X-Request-Id=UjW8vSDh5Kr
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 18:14:11 GMT
Accept-Ranges=bytes
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/2593f948ab15ada8
FAIL (2026-02-24 18:14:11 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897415E4058B2D7</RequestId><HostId></HostId></Error>"
Duration: 11.235389ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................]
duration:
2.173604876s
trace:
https://jaeger.dev.storj.io/trace/24b4edf9256675dc
FAIL (2026-02-24 18:14:08 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
7EICWCWMEABP3ENF5Q, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.249727323 (165h26m16.388711507s) [noise=true , address=81.171.14.70:4036    , piece_id=N4AIPU6IKD3HPSXHROJSWHFLAN573JOD6W6TUTV6FZQEMWVYCSHA, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250011063 (165h26m16.388995257s) [noise=true , address=185.167.204.206:4070 , piece_id=OQP5Z7ZJ3K76NJK3QSMAZEJTI6HFT7FUHT5E5IXAX4RJLHMB4I7A, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250290094 (165h26m16.389274278s) [noise=true , address=185.167.204.206:4056 , piece_id=YJJKP7ZHN6XESSLSHRTNWBCVU7ZLDNPQUUPE7V2ZMOLR4UJ2WX5Q, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250587089 (165h26m16.389571283s) [noise=true , address=185.167.204.205:4026 , piece_id=JMBMNNNQGEPQ5I5PGG6ZLNP2SAJEOPXM3KVTB6NMVYBVTBU27I2Q, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250850792 (165h26m16.389834976s) [noise=true , address=81.171.14.70:4030    , piece_id=B4LMP6JJEI7KFLUTDP4LTLX3DKB6EJASZLQLHXX4PHXOYDW6V2LA, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.724619104 (165h26m16.863603319s) [upload=145547]: Next returned nil segment
Feb 24 17:34:57.724631829 (165h26m16.863616042s) [upload=145547]: Waiting for error group managing segments...
Feb 24 17:34:57.901571686 (165h26m17.04055587s) [noise=true , address=89.149.201.147:4011  , piece_id=UYS6AJGSLDCVZ2R2YYZQP7W7S3RNKGW5RPPPCATQGULFW6HS7HDQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.908951002 (165h26m17.047935196s) [noise=true , address=89.149.201.147:4012  , piece_id=TSXMBWUIWR4S3CGSTJF6Y35EM22QFYSOB3HLGBV7LBZW4MKV7QFQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.915198182 (165h26m17.054182396s) [noise=true , address=185.167.204.205:4026 , piece_id=JMBMNNNQGEPQ5I5PGG6ZLNP2SAJEOPXM3KVTB6NMVYBVTBU27I2Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.915867082 (165h26m17.054851295s) [noise=true , address=185.167.204.205:4027 , piece_id=7AKTJIIAHEOOP3BNPWH4TB7ISZO7G6UM3JPYQLOF3MATWPZOEPCA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.916644374 (165h26m17.055628588s) [noise=true , address=185.167.204.205:4036 , piece_id=5UFBMTYMSM5VCPXZISA7PLK3B6WPTEHVTRIPMAUTEIFQ5CDRBQVQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.917614386 (165h26m17.0565986s) [noise=true , address=89.149.201.147:4023  , piece_id=NXX5UHIY23R5NVUM3QEMMFHYUVYFRRMLBZNUVELN3ZTAJSTCGUHA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.933365171 (165h26m17.072349365s) [noise=true , address=89.149.201.147:4014  , piece_id=IUSO2AFUBTVD4RUQXBY7GMLF6QX6U5UPS6J34Y2ZHSXMK4BK3WUA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.938423079 (165h26m17.077407294s) [noise=true , address=185.167.204.205:4004 , piece_id=O3OFG2BPNLEWVLL2FSPTDOKKVT7FUBEIISOWVRI7VD2ZDR5PBVNQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.964706541 (165h26m17.103690755s) [noise=true , address=185.167.204.206:4069 , piece_id=XAOTFHYPCHWOXE67HR5EB56FICFCTBGEOVE7KVSQV2FQ2NWDNKWA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.965170328 (165h26m17.104154512s) [noise=true , address=185.167.204.205:4012 , piece_id=Q5JTWCNRG4SBMAE4YCJKJHGDQPE7AOINO2LRLBRGXW5O36OB5WVA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.971952097 (165h26m17.11093631s) [noise=true , address=185.167.204.206:4053 , piece_id=O6BLFT5UE3IEWSHAAUTGYTBINPYSWFBTLWC4TYPW3XN5VPLBDKRQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.972322990 (165h26m17.111307173s) [noise=true , address=185.167.204.206:4066 , piece_id=5FVO2YQGZV2WOAZ7T5H3LNJUNXXMK55OCZENG35DFEEWBLA5N5GQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.975251300 (165h26m17.114235483s) [noise=true , address=185.167.204.206:4041 , piece_id=DDMUQAEF7JPW6FR6LYCWH3AWY5HF4SA7IQCBOOKHOFAVZLWE23DQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.980987377 (165h26m17.11997159s) [noise=true , address=185.167.204.206:4070 , piece_id=OQP5Z7ZJ3K76NJK3QSMAZEJTI6HFT7FUHT5E5IXAX4RJLHMB4I7A, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.983946945 (165h26m17.122931129s) [noise=true , address=185.167.204.206:4056 , piece_id=YJJKP7ZHN6XESSLSHRTNWBCVU7ZLDNPQUUPE7V2ZMOLR4UJ2WX5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.989584816 (165h26m17.128569041s) [noise=true , address=89.149.201.147:4018  , piece_id=OEQOZB5IRSIY5CR5UJ5XXMZPDGH4XN6KQ7ZGCZMBYNBX6OSMOKQQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.995870059 (165h26m17.134854243s) [noise=true , address=89.149.201.147:4013  , piece_id=R6HK4UBOGRHIEOHSJJA7DRSVDRNF27QW4Z7EICWCWMEABP3ENF5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:49.889621672 (165h27m9.028605886s) [noise=true , address=81.171.14.70:4036    , piece_id=N4AIPU6IKD3HPSXHROJSWHFLAN573JOD6W6TUTV6FZQEMWVYCSHA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:50.581661013 (165h27m9.720645197s) [noise=true , address=81.171.14.70:4034    , piece_id=2B3TO6XY2NVRX5SQ5SUW6OEMLWZHYNPWHOHBL5EAWM2PEDV4KHHQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:53.182181244 (165h27m12.321165459s) [noise=true , address=81.171.14.70:4033    , piece_id=H6ZB652A5CNAUCNLXHRMXJKXRNBK2HGWENUY3AKCRSWMK2IHE3AA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:55.084212904 (165h27m14.223197098s) [noise=true , address=81.171.14.70:4041    , piece_id=XGTKMITYQPT67CNFDJJGZW3TWFNIFGMGZYBBV7RDGNSPJGBBKX5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:56.826408639 (165h27m15.965392853s) [noise=true , address=81.171.14.70:4047    , piece_id=SLTCRDUZZ74TF7UUKKA3ZW4DV4RO7VO7CW37RZ3KOTXCPNEBWVAQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 5.161.89.252:51760->81.171.14.70:4047: use of closed network connection; write tcp 5.161.89.252:51760->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:51760->81.171.14.70:4047: use of closed network connection
Feb 24 17:35:56.826540285 (165h27m15.965524498s) [noise=true , address=81.171.14.70:4037    , piece_id=Z7IPSTK2E3WQ6RPTB43HFST52BECH7VRHLKPV6V5FWOMJ7YNWFCA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 5.161.89.252:61326->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 17:35:56.826589036 (165h27m15.96557326s) [noise=true , address=81.171.14.70:4030    , piece_id=B4LMP6JJEI7KFLUTDP4LTLX3DKB6EJASZLQLHXX4PHXOYDW6V2LA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 5.161.89.252:54788->81.171.14.70:4030: use of closed network connection; write tcp 5.161.89.252:54788->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54788->81.171.14.70:4030: use of closed network connection
Feb 24 17:35:56.826781545 (165h27m15.965765759s) [noise=true , address=81.171.14.70:4042    , piece_id=FP4T4TB3C5K2HORTY55FWKP4AQYJYTT3AIQE5ERTDG6IVEKLXB6Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: read tcp 5.161.89.252:16670->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 17:35:56.826879228 (165h27m15.965863452s) [noise=true , address=81.171.14.70:4048    , piece_id=S5QG4SXCIEBZAJCPNY3GYLWO3OA3LXPMGDZWLIVTJMC5WZ7MIT5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF
Feb 24 17:35:56.827059424 (165h27m15.966043638s) [noise=true , address=81.171.14.70:4046    , piece_id=ROYQDMKWPNWJWK2ZXNO46P75STGAHHN7OHTR2ABQNBGCCYKTABQQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 5.161.89.252:12860->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 17:35:56.827234200 (165h27m15.966218415s) [noise=true , address=81.171.14.70:4029    , piece_id=ANBM4PEUW4YPPXUYUB2VAKXMDBEXBD7CO42CXEHAJ2W5NDNXL4WQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:10314->81.171.14.70:4029: use of closed network connection; write tcp 5.161.89.252:10314->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:10314->81.171.14.70:4029: use of closed network connection
Feb 24 17:35:56.827285327 (165h27m15.966269551s) [seg_pos={0 0}, upload=145547]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Feb 24 17:35:56.937070410 (165h27m16.076054634s) [upload=145547]: Done uploading segments...
Feb 24 17:35:56.937143686 (165h27m16.076127911s) [upload=145547]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 2.173627689s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
30.000528585s
trace:
https://jaeger.dev.storj.io/trace/397471d6b990b087
FAIL (2026-02-24 18:14:04 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 30.0005472s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
30.000357268s
trace:
https://jaeger.dev.storj.io/trace/6e533bde98f149d5
FAIL (2026-02-24 18:14:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000371395s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
25.476994ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Type=application/xml
Vary=Origin
X-Request-Id=h3ng59UAF27
Date=Tue, 24 Feb 2026 18:13:47 GMT
Content-Security-Policy=block-all-mixed-content
Server=Storj
X-Amz-Request-Id=18974158BE9357C2
X-Xss-Protection=1; mode=block
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/15f3160ef74a9c4b
FAIL (2026-02-24 18:13:47 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974158BE9357C2</RequestId><HostId></HostId></Error>"
Duration: 25.500107ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
26.032172ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=189741582F1FC24D
Date=Tue, 24 Feb 2026 18:13:45 GMT
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Request-Id=3U9VwjnLCBZ
X-Xss-Protection=1; mode=block
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/40b8a1daa9e34d3a
FAIL (2026-02-24 18:13:45 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189741582F1FC24D</RequestId><HostId></HostId></Error>"
Duration: 26.058381ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration:
30.001672729s
trace:
https://jaeger.dev.storj.io/trace/4e0be69bd7467028
FAIL (2026-02-24 18:13:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001686254s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
30.001120548s
trace:
https://jaeger.dev.storj.io/trace/9a08e43f076a192
FAIL (2026-02-24 18:13:43 UTC)
orbiter warning: operation: sync2.Copy
uplink: encryption: context deadline exceeded
Duration: 30.001152256s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
1m0.001274122s
trace:
https://jaeger.dev.storj.io/trace/4e46244a75c48e44
FAIL (2026-02-24 18:13:43 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:12:43.914690716 (166h4m3.05367493s) [upload=146095]: Starting upload
Feb 24 18:12:43.914765266 (166h4m3.05374948s) [upload=146095]: Done starting upload
Feb 24 18:12:43.914824586 (166h4m3.0538088s) [upload=146095]: Uploading segments...
Feb 24 18:12:43.915680876 (166h4m3.05466509s) [upload=146095]: Got next segment. Inline: false
Feb 24 18:12:43.915728726 (166h4m3.054712939s) [upload=146095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:12:43.915735548 (166h4m3.054719763s) [upload=146095]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:13:43.896644162 (166h5m3.035628347s) [upload=146095]: Next segment err: context deadline exceeded
Feb 24 18:13:43.896808049 (166h5m3.035792223s) [upload=146095]: Done uploading segments...
Feb 24 18:13:43.896834348 (166h5m3.035818533s) [upload=146095]: Upload finished. err: context deadline exceeded
Duration: 1m0.001292916s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
30.000693115s
trace:
https://jaeger.dev.storj.io/trace/60aa81e1203e855c
FAIL (2026-02-24 18:13:40 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:13:10.589015495 (166h4m29.727999709s) [upload=146100]: Starting upload
Feb 24 18:13:10.589124419 (166h4m29.728108633s) [upload=146100]: Done starting upload
Feb 24 18:13:10.589210029 (166h4m29.728194242s) [upload=146100]: Uploading segments...
Feb 24 18:13:10.589263960 (166h4m29.728248184s) [upload=146100]: Got next segment. Inline: true
Feb 24 18:13:10.589271023 (166h4m29.728255237s) [upload=146100]: Waiting for error group managing segments...
Feb 24 18:13:10.589345772 (166h4m29.728329987s) [upload=146100]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:13:10.589352154 (166h4m29.728336378s) [upload=146100]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:13:10.589356012 (166h4m29.728340225s) [upload=146100]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:13:40.575577750 (166h4m59.714561944s) [upload=146100]: Done uploading segments...
Feb 24 18:13:40.575608236 (166h4m59.71459243s) [upload=146100]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.000716587s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X]
duration:
5.000756821s
trace:
https://jaeger.dev.storj.io/trace/74a421320e9af30f
FAIL (2026-02-24 18:13:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000775065s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
1m0.000642091s
trace:
https://jaeger.dev.storj.io/trace/34a057be418d709e
FAIL (2026-02-24 18:13:38 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:12:38.659128621 (166h3m57.798112835s) [upload=146093]: Starting upload
Feb 24 18:12:38.659232787 (166h3m57.798217001s) [upload=146093]: Done starting upload
Feb 24 18:12:38.659348643 (166h3m57.798332857s) [upload=146093]: Uploading segments...
Feb 24 18:12:38.659429874 (166h3m57.798414098s) [upload=146093]: Got next segment. Inline: true
Feb 24 18:12:38.659440484 (166h3m57.798424708s) [upload=146093]: Waiting for error group managing segments...
Feb 24 18:12:38.659517689 (166h3m57.798501903s) [upload=146093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:12:38.659524151 (166h3m57.798508375s) [upload=146093]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:12:38.659528108 (166h3m57.798512322s) [upload=146093]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:13:38.645028351 (166h4m57.784012535s) [upload=146093]: Done uploading segments...
Feb 24 18:13:38.645056535 (166h4m57.784040718s) [upload=146093]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m0.000656206s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
43.63652ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=1897415664176396
X-Request-Id=R6WZtryKAa2
X-Xss-Protection=1; mode=block
Content-Length=274
Vary=Origin
Date=Tue, 24 Feb 2026 18:13:37 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/31540d1a61867295
FAIL (2026-02-24 18:13:37 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897415664176396</RequestId><HostId></HostId></Error>"
Duration: 43.653119ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.000856573s
trace:
https://jaeger.dev.storj.io/trace/2e3d2e4bec7803e9
FAIL (2026-02-24 18:13:25 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
Feb 24 18:12:55.319451459 (166h4m14.458435673s) [upload=146097]: Starting upload
Feb 24 18:12:55.319517933 (166h4m14.458502148s) [upload=146097]: Done starting upload
Feb 24 18:12:55.319611809 (166h4m14.458596023s) [upload=146097]: Uploading segments...
Feb 24 18:12:55.319965289 (166h4m14.458949514s) [upload=146097]: Got next segment. Inline: false
Feb 24 18:12:55.320046811 (166h4m14.459031085s) [upload=146097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:12:55.320057652 (166h4m14.459041865s) [upload=146097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:13:25.305913171 (166h4m44.444897385s) [upload=146097]: Next segment err: context deadline exceeded
Feb 24 18:13:25.306309842 (166h4m44.445294056s) [upload=146097]: Done uploading segments...
Feb 24 18:13:25.306362731 (166h4m44.445346945s) [upload=146097]: Upload finished. err: context deadline exceeded
Duration: 30.00087641s core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
14.754554ms
remote:
"tcp:45.38.24.2:443"
response headers:
X-Amz-Request-Id=1897415378D9708F
Date=Tue, 24 Feb 2026 18:13:25 GMT
Accept-Ranges=bytes
Vary=Origin
X-Request-Id=F9EwUGAunWy
X-Xss-Protection=1; mode=block
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/35aa0823358258c7
FAIL (2026-02-24 18:13:25 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897415378D9708F</RequestId><HostId></HostId></Error>"
Duration: 14.779029ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
1m0.001831102s
trace:
https://jaeger.dev.storj.io/trace/36ad8627c2a6f720
FAIL (2026-02-24 18:13:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001846299s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................]
duration:
2.16177661s
trace:
https://jaeger.dev.storj.io/trace/24b4edf9256675dc
FAIL (2026-02-24 18:13:22 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 21)
======LOGS======
7EICWCWMEABP3ENF5Q, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.249727323 (165h26m16.388711507s) [noise=true , address=81.171.14.70:4036    , piece_id=N4AIPU6IKD3HPSXHROJSWHFLAN573JOD6W6TUTV6FZQEMWVYCSHA, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250011063 (165h26m16.388995257s) [noise=true , address=185.167.204.206:4070 , piece_id=OQP5Z7ZJ3K76NJK3QSMAZEJTI6HFT7FUHT5E5IXAX4RJLHMB4I7A, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250290094 (165h26m16.389274278s) [noise=true , address=185.167.204.206:4056 , piece_id=YJJKP7ZHN6XESSLSHRTNWBCVU7ZLDNPQUUPE7V2ZMOLR4UJ2WX5Q, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250587089 (165h26m16.389571283s) [noise=true , address=185.167.204.205:4026 , piece_id=JMBMNNNQGEPQ5I5PGG6ZLNP2SAJEOPXM3KVTB6NMVYBVTBU27I2Q, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.250850792 (165h26m16.389834976s) [noise=true , address=81.171.14.70:4030    , piece_id=B4LMP6JJEI7KFLUTDP4LTLX3DKB6EJASZLQLHXX4PHXOYDW6V2LA, seg_pos={0 0}, upload=145547]: Uploading piece...
Feb 24 17:34:57.724619104 (165h26m16.863603319s) [upload=145547]: Next returned nil segment
Feb 24 17:34:57.724631829 (165h26m16.863616042s) [upload=145547]: Waiting for error group managing segments...
Feb 24 17:34:57.901571686 (165h26m17.04055587s) [noise=true , address=89.149.201.147:4011  , piece_id=UYS6AJGSLDCVZ2R2YYZQP7W7S3RNKGW5RPPPCATQGULFW6HS7HDQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.908951002 (165h26m17.047935196s) [noise=true , address=89.149.201.147:4012  , piece_id=TSXMBWUIWR4S3CGSTJF6Y35EM22QFYSOB3HLGBV7LBZW4MKV7QFQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.915198182 (165h26m17.054182396s) [noise=true , address=185.167.204.205:4026 , piece_id=JMBMNNNQGEPQ5I5PGG6ZLNP2SAJEOPXM3KVTB6NMVYBVTBU27I2Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.915867082 (165h26m17.054851295s) [noise=true , address=185.167.204.205:4027 , piece_id=7AKTJIIAHEOOP3BNPWH4TB7ISZO7G6UM3JPYQLOF3MATWPZOEPCA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.916644374 (165h26m17.055628588s) [noise=true , address=185.167.204.205:4036 , piece_id=5UFBMTYMSM5VCPXZISA7PLK3B6WPTEHVTRIPMAUTEIFQ5CDRBQVQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.917614386 (165h26m17.0565986s) [noise=true , address=89.149.201.147:4023  , piece_id=NXX5UHIY23R5NVUM3QEMMFHYUVYFRRMLBZNUVELN3ZTAJSTCGUHA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.933365171 (165h26m17.072349365s) [noise=true , address=89.149.201.147:4014  , piece_id=IUSO2AFUBTVD4RUQXBY7GMLF6QX6U5UPS6J34Y2ZHSXMK4BK3WUA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.938423079 (165h26m17.077407294s) [noise=true , address=185.167.204.205:4004 , piece_id=O3OFG2BPNLEWVLL2FSPTDOKKVT7FUBEIISOWVRI7VD2ZDR5PBVNQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.964706541 (165h26m17.103690755s) [noise=true , address=185.167.204.206:4069 , piece_id=XAOTFHYPCHWOXE67HR5EB56FICFCTBGEOVE7KVSQV2FQ2NWDNKWA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.965170328 (165h26m17.104154512s) [noise=true , address=185.167.204.205:4012 , piece_id=Q5JTWCNRG4SBMAE4YCJKJHGDQPE7AOINO2LRLBRGXW5O36OB5WVA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.971952097 (165h26m17.11093631s) [noise=true , address=185.167.204.206:4053 , piece_id=O6BLFT5UE3IEWSHAAUTGYTBINPYSWFBTLWC4TYPW3XN5VPLBDKRQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.972322990 (165h26m17.111307173s) [noise=true , address=185.167.204.206:4066 , piece_id=5FVO2YQGZV2WOAZ7T5H3LNJUNXXMK55OCZENG35DFEEWBLA5N5GQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.975251300 (165h26m17.114235483s) [noise=true , address=185.167.204.206:4041 , piece_id=DDMUQAEF7JPW6FR6LYCWH3AWY5HF4SA7IQCBOOKHOFAVZLWE23DQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.980987377 (165h26m17.11997159s) [noise=true , address=185.167.204.206:4070 , piece_id=OQP5Z7ZJ3K76NJK3QSMAZEJTI6HFT7FUHT5E5IXAX4RJLHMB4I7A, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.983946945 (165h26m17.122931129s) [noise=true , address=185.167.204.206:4056 , piece_id=YJJKP7ZHN6XESSLSHRTNWBCVU7ZLDNPQUUPE7V2ZMOLR4UJ2WX5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.989584816 (165h26m17.128569041s) [noise=true , address=89.149.201.147:4018  , piece_id=OEQOZB5IRSIY5CR5UJ5XXMZPDGH4XN6KQ7ZGCZMBYNBX6OSMOKQQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:34:57.995870059 (165h26m17.134854243s) [noise=true , address=89.149.201.147:4013  , piece_id=R6HK4UBOGRHIEOHSJJA7DRSVDRNF27QW4Z7EICWCWMEABP3ENF5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:49.889621672 (165h27m9.028605886s) [noise=true , address=81.171.14.70:4036    , piece_id=N4AIPU6IKD3HPSXHROJSWHFLAN573JOD6W6TUTV6FZQEMWVYCSHA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:50.581661013 (165h27m9.720645197s) [noise=true , address=81.171.14.70:4034    , piece_id=2B3TO6XY2NVRX5SQ5SUW6OEMLWZHYNPWHOHBL5EAWM2PEDV4KHHQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:53.182181244 (165h27m12.321165459s) [noise=true , address=81.171.14.70:4033    , piece_id=H6ZB652A5CNAUCNLXHRMXJKXRNBK2HGWENUY3AKCRSWMK2IHE3AA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:55.084212904 (165h27m14.223197098s) [noise=true , address=81.171.14.70:4041    , piece_id=XGTKMITYQPT67CNFDJJGZW3TWFNIFGMGZYBBV7RDGNSPJGBBKX5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: <nil>
Feb 24 17:35:56.826408639 (165h27m15.965392853s) [noise=true , address=81.171.14.70:4047    , piece_id=SLTCRDUZZ74TF7UUKKA3ZW4DV4RO7VO7CW37RZ3KOTXCPNEBWVAQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: write tcp 5.161.89.252:51760->81.171.14.70:4047: use of closed network connection; write tcp 5.161.89.252:51760->81.171.14.70:4047: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:51760->81.171.14.70:4047: use of closed network connection
Feb 24 17:35:56.826540285 (165h27m15.965524498s) [noise=true , address=81.171.14.70:4037    , piece_id=Z7IPSTK2E3WQ6RPTB43HFST52BECH7VRHLKPV6V5FWOMJ7YNWFCA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:1HSPWfW4L5gN2YoEV8rcqhQtVFv83M21nseT9MZSTgwJo76yGx, address:81.171.14.70:4037): protocol: read tcp 5.161.89.252:61326->81.171.14.70:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 17:35:56.826589036 (165h27m15.96557326s) [noise=true , address=81.171.14.70:4030    , piece_id=B4LMP6JJEI7KFLUTDP4LTLX3DKB6EJASZLQLHXX4PHXOYDW6V2LA, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 5.161.89.252:54788->81.171.14.70:4030: use of closed network connection; write tcp 5.161.89.252:54788->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:54788->81.171.14.70:4030: use of closed network connection
Feb 24 17:35:56.826781545 (165h27m15.965765759s) [noise=true , address=81.171.14.70:4042    , piece_id=FP4T4TB3C5K2HORTY55FWKP4AQYJYTT3AIQE5ERTDG6IVEKLXB6Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: read tcp 5.161.89.252:16670->81.171.14.70:4042: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 17:35:56.826879228 (165h27m15.965863452s) [noise=true , address=81.171.14.70:4048    , piece_id=S5QG4SXCIEBZAJCPNY3GYLWO3OA3LXPMGDZWLIVTJMC5WZ7MIT5Q, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:12bbN67ZebXjF4iSyaWu4TDsG1XugTm1YdNHqRdRCbZ2WWRunRG, address:81.171.14.70:4048): protocol: expected piece hash; context deadline exceeded; EOF
Feb 24 17:35:56.827059424 (165h27m15.966043638s) [noise=true , address=81.171.14.70:4046    , piece_id=ROYQDMKWPNWJWK2ZXNO46P75STGAHHN7OHTR2ABQNBGCCYKTABQQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 5.161.89.252:12860->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 17:35:56.827234200 (165h27m15.966218415s) [noise=true , address=81.171.14.70:4029    , piece_id=ANBM4PEUW4YPPXUYUB2VAKXMDBEXBD7CO42CXEHAJ2W5NDNXL4WQ, seg_pos={0 0}, upload=145547]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: write tcp 5.161.89.252:10314->81.171.14.70:4029: use of closed network connection; write tcp 5.161.89.252:10314->81.171.14.70:4029: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:10314->81.171.14.70:4029: use of closed network connection
Feb 24 17:35:56.827285327 (165h27m15.966269551s) [seg_pos={0 0}, upload=145547]: Done waiting for segment. successful: 21 optimal: 26 errs: <nil>
Feb 24 17:35:56.937070410 (165h27m16.076054634s) [upload=145547]: Done uploading segments...
Feb 24 17:35:56.937143686 (165h27m16.076127911s) [upload=145547]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 21)
Duration: 2.161803881s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.00158435s
trace:
https://jaeger.dev.storj.io/trace/4c9e9e715276542e
FAIL (2026-02-24 18:13:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001645745s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration:
30.00150739s
trace:
https://jaeger.dev.storj.io/trace/2528ce9b801f74f5
FAIL (2026-02-24 18:13:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001531334s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.001563273s
trace:
https://jaeger.dev.storj.io/trace/54820470a56cfde0
FAIL (2026-02-24 18:13:06 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:12:36.425978667 (166h3m55.564962861s) [upload=146092]: Starting upload
Feb 24 18:12:36.426021497 (166h3m55.565005691s) [upload=146092]: Done starting upload
Feb 24 18:12:36.426079535 (166h3m55.565063729s) [upload=146092]: Uploading segments...
Feb 24 18:12:36.426113118 (166h3m55.565097312s) [upload=146092]: Got next segment. Inline: true
Feb 24 18:12:36.426116885 (166h3m55.565101068s) [upload=146092]: Waiting for error group managing segments...
Feb 24 18:12:36.426152201 (166h3m55.565136395s) [upload=146092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:12:36.426155898 (166h3m55.565140082s) [upload=146092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:12:36.426158403 (166h3m55.565142597s) [upload=146092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:13:06.413382037 (166h4m25.552366252s) [upload=146092]: Done uploading segments...
Feb 24 18:13:06.413423754 (166h4m25.552407969s) [upload=146092]: Upload finished. err: metaclient: context deadline exceeded
Duration: 30.001585976s core uplink us-select-1