Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 666062 reports (Page 10038 of 13322)
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
9 out of 60 is failed (threshold=6) [XXX.XXXXXX..................................................]
duration:
42.128453ms
remote:
"tcp:136.0.77.4:443"
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 19:16:28 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 42.152838ms edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
12 out of 60 is failed (threshold=3) [XXXXXXXXXXXX................................................]
duration:
172.869818ms
trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 19:16:26 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 172.890167ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.XX..........................................]
duration:
457.906144ms
trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 19:16:20 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 457.943725ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
24.965891ms
remote:
"tcp:136.0.77.3:443"
response headers:
Vary=Origin
X-Amz-Request-Id=189744C184808B5D
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
X-Request-Id=jF5uer4JsM
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 19:16:16 GMT
Content-Type=application/xml
Server=Storj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/434d410eb935fe31
FAIL (2026-02-24 19:16:16 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744C184808B5D</RequestId><HostId></HostId></Error>"
Duration: 24.987381ms edge gateway vhost bgp eu1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
22.511144ms
remote:
"tcp:136.0.77.3:443"
response headers:
Vary=Origin
X-Amz-Request-Id=189744C10D9ADE93
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 19:16:14 GMT
Content-Length=274
Content-Type=application/xml
X-Request-Id=D41P2Esqq3s
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
Server=Storj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/5dbcfe3475b8f99d
FAIL (2026-02-24 19:16:14 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744C10D9ADE93</RequestId><HostId></HostId></Error>"
Duration: 22.525882ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX.X........................................]
duration:
203.874569ms
trace:
https://jaeger.dev.storj.io/trace/5b29a0cacadf86f0
FAIL (2026-02-24 19:16:07 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:44:31.418187254 (166h35m50.557171448s) [upload=146507]: Starting upload
Feb 24 18:44:31.418228731 (166h35m50.557212916s) [upload=146507]: Done starting upload
Feb 24 18:44:31.418274858 (166h35m50.557259042s) [upload=146507]: Uploading segments...
Feb 24 18:44:31.418305145 (166h35m50.557289339s) [upload=146507]: Got next segment. Inline: true
Feb 24 18:44:31.418308962 (166h35m50.557293156s) [upload=146507]: Waiting for error group managing segments...
Feb 24 18:44:31.418363463 (166h35m50.557347657s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:44:31.418369304 (166h35m50.557353488s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:44:31.418372259 (166h35m50.557356443s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:50.941040072 (166h36m10.080024286s) [upload=146507]: Done uploading segments...
Feb 24 18:44:50.941058296 (166h36m10.08004251s) [upload=146507]: Upload finished. err: <nil>
Duration: 203.888246ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX...........................................]
duration:
578.154875ms
trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 19:16:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 578.174413ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.........................................]
duration:
375.090981ms
trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:16:05 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 375.111188ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
25.502453ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Security-Policy=block-all-mixed-content
Vary=Origin
X-Amz-Request-Id=189744BDE407903C
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 19:16:00 GMT
Accept-Ranges=bytes
Content-Type=application/xml
Server=Storj
X-Request-Id=8WogGcbAqkh
Content-Length=274
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/2605b4a259a840f6
FAIL (2026-02-24 19:16:00 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744BDE407903C</RequestId><HostId></HostId></Error>"
Duration: 25.52195ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
10 out of 60 is failed (threshold=6) [XXXX.XXXXXX.................................................]
duration:
42.288282ms
remote:
"tcp:136.0.77.4:443"
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 19:15:58 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 42.307907ms edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX.XX.........................................]
duration:
350.309965ms
trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 19:15:53 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 350.330703ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX.XX............................................]
duration:
1.710928408s
trace:
https://jaeger.dev.storj.io/trace/c09458d54de96a9
FAIL (2026-02-24 19:15:52 UTC)
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.710947764s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
6 out of 60 is failed (threshold=6) [....X.XXX...X.....X.........................................]
duration:
516.653546ms
trace:
https://jaeger.dev.storj.io/trace/29c8bea8f1a363cb
FAIL (2026-02-24 19:15:49 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 516.673744ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX...........................................]
duration:
223.026159ms
trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 19:15:47 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload
Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload
Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments...
Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true
Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments...
Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments...
Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 223.048852ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
22 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXX......................................]
duration:
770.648195ms
trace:
https://jaeger.dev.storj.io/trace/7ea78b408ceac77f
FAIL (2026-02-24 19:15:45 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
1s) [noise=true , address=79.127.219.41:4948   , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919349510 (166h35m20.058333704s) [noise=true , address=79.127.219.46:4900   , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919385177 (166h35m20.058369371s) [noise=true , address=45.91.116.13:4179    , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919848713 (166h35m20.058832897s) [noise=true , address=77.90.31.19:4855     , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920149715 (166h35m20.059133899s) [noise=true , address=45.91.116.6:4985     , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920391487 (166h35m20.059375681s) [noise=true , address=45.91.116.12:4252    , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920646944 (166h35m20.059631128s) [noise=true , address=77.90.31.21:4911     , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920909065 (166h35m20.059893248s) [noise=true , address=145.79.227.35:4491   , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921156867 (166h35m20.060141051s) [noise=true , address=77.90.31.13:4636     , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921400382 (166h35m20.060384576s) [noise=true , address=193.149.164.66:4972  , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921659165 (166h35m20.060643349s) [noise=true , address=45.91.116.8:4052     , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921973843 (166h35m20.060958037s) [noise=true , address=77.90.31.16:4742     , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922281628 (166h35m20.061265822s) [noise=true , address=145.79.227.34:4939   , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922631973 (166h35m20.061616157s) [noise=true , address=145.79.227.37:4582   , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.924956486 (166h35m20.06394068s) [noise=true , address=145.79.227.14:4846   , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.926527841 (166h35m20.065512036s) [noise=true , address=145.79.227.29:4970   , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.928105218 (166h35m20.067089402s) [noise=true , address=45.91.116.14:4204    , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.929764789 (166h35m20.068748983s) [noise=true , address=77.90.31.14:4689     , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:01.012045757 (166h35m20.151029971s) [upload=146493]: Next returned nil segment
Feb 24 18:44:01.012057469 (166h35m20.151041683s) [upload=146493]: Waiting for error group managing segments...
Feb 24 18:44:01.020560936 (166h35m20.15954515s) [noise=true , address=45.91.116.8:4052     , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.022333197 (166h35m20.161317401s) [noise=true , address=79.127.219.46:4900   , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.035953132 (166h35m20.174937356s) [noise=true , address=145.79.227.35:4491   , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.036725164 (166h35m20.175709388s) [noise=true , address=45.91.116.12:4252    , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.041227315 (166h35m20.180211529s) [noise=true , address=45.91.116.6:4985     , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.044901219 (166h35m20.183885433s) [noise=true , address=45.91.116.14:4204    , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.046613308 (166h35m20.185597521s) [noise=true , address=77.90.31.16:4742     , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.049905900 (166h35m20.188890123s) [noise=true , address=77.90.31.19:4855     , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.050217330 (166h35m20.189201544s) [noise=true , address=77.90.31.13:4636     , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063062278 (166h35m20.202046492s) [noise=true , address=77.90.31.14:4689     , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063877701 (166h35m20.202861915s) [noise=true , address=45.91.116.13:4179    , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.066973164 (166h35m20.205957379s) [noise=true , address=77.90.31.21:4911     , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.093746163 (166h35m20.232730377s) [noise=true , address=145.79.227.14:4846   , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099012601 (166h35m20.237996825s) [noise=true , address=145.79.227.29:4970   , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099029282 (166h35m20.238013496s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 14 pieces
Feb 24 18:44:01.099459185 (166h35m20.2384434s) [noise=true , address=79.127.219.41:4948   , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gXNjKMdu97i8BC5fYWMiMf3FTepsmHsViuksBWNVLpraTJ1XW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099506874 (166h35m20.238491089s) [noise=true , address=79.127.219.41:4948   , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099675470 (166h35m20.238659684s) [noise=true , address=145.79.227.37:4582   , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099683645 (166h35m20.238667859s) [noise=true , address=145.79.227.37:4582   , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099865534 (166h35m20.238849749s) [noise=true , address=193.149.164.66:4972  , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128eDneuvfeZbqFp8YQhWHLb7hWrw7T3a2EJ7tzZkkYhaNq7CMT): protocol: read tcp 5.161.89.252:24006->193.149.164.66:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:44:01.099872908 (166h35m20.238857132s) [noise=true , address=193.149.164.66:4972  , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.100082470 (166h35m20.239066684s) [noise=true , address=145.79.227.34:4939   , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.100105593 (166h35m20.239089808s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 15 pieces
Feb 24 18:44:01.100170554 (166h35m20.239154778s) [seg_pos={0 0}, upload=146493]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Feb 24 18:44:01.100364717 (166h35m20.239348941s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:01.100379766 (166h35m20.23936399s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:14.739172222 (166h35m33.878156437s) [upload=146493]: Done uploading segments...
Feb 24 18:44:14.739199784 (166h35m33.878184008s) [upload=146493]: Upload finished. err: <nil>
Duration: 770.66238ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
24.481706ms
remote:
"tcp:45.38.24.2:443"
response headers:
Server=Storj
X-Amz-Request-Id=189744BA5FB95C9E
X-Request-Id=ibg7f7K7VFn
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 19:15:45 GMT
Content-Length=284
Content-Type=application/xml
Vary=Origin
Accept-Ranges=bytes
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/3b5214d3b9a8a4bd
FAIL (2026-02-24 19:15:45 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744BA5FB95C9E</RequestId><HostId></HostId></Error>"
Duration: 24.491753ms edge gateway vhost us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
31.691655ms
remote:
"tcp:136.0.77.3:443"
response headers:
Content-Type=application/xml
Server=Storj
X-Amz-Request-Id=189744BA5EEA5CF4
Date=Tue, 24 Feb 2026 19:15:45 GMT
Accept-Ranges=bytes
Content-Length=274
Vary=Origin
X-Request-Id=CdtfyH2jt1g
X-Xss-Protection=1; mode=block
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/aa14c44ef3196ff
FAIL (2026-02-24 19:15:45 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744BA5EEA5CF4</RequestId><HostId></HostId></Error>"
Duration: 31.703628ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX.X........................................]
duration:
190.392154ms
trace:
https://jaeger.dev.storj.io/trace/5383e9cc16a1cf07
FAIL (2026-02-24 19:15:41 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 190.420897ms core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
11 out of 60 is failed (threshold=6) [XXXXX.XXXXXX................................................]
duration:
74.987638ms
remote:
"tcp:136.0.77.4:443"
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 19:15:38 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 75.008587ms edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
13 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX...............................................]
duration:
193.533792ms
trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 19:15:36 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 193.562145ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
16 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX.XX...........................................]
duration:
1.707819069s
trace:
https://jaeger.dev.storj.io/trace/c09458d54de96a9
FAIL (2026-02-24 19:15:30 UTC)
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.70784084s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.X.......................................]
duration:
167.961449ms
trace:
https://jaeger.dev.storj.io/trace/5b29a0cacadf86f0
FAIL (2026-02-24 19:15:29 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:44:31.418187254 (166h35m50.557171448s) [upload=146507]: Starting upload
Feb 24 18:44:31.418228731 (166h35m50.557212916s) [upload=146507]: Done starting upload
Feb 24 18:44:31.418274858 (166h35m50.557259042s) [upload=146507]: Uploading segments...
Feb 24 18:44:31.418305145 (166h35m50.557289339s) [upload=146507]: Got next segment. Inline: true
Feb 24 18:44:31.418308962 (166h35m50.557293156s) [upload=146507]: Waiting for error group managing segments...
Feb 24 18:44:31.418363463 (166h35m50.557347657s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:44:31.418369304 (166h35m50.557353488s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:44:31.418372259 (166h35m50.557356443s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:50.941040072 (166h36m10.080024286s) [upload=146507]: Done uploading segments...
Feb 24 18:44:50.941058296 (166h36m10.08004251s) [upload=146507]: Upload finished. err: <nil>
Duration: 167.9775ms core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
6 out of 60 is failed (threshold=6) [.....X.XXX...X.....X........................................]
duration:
510.539188ms
trace:
https://jaeger.dev.storj.io/trace/29c8bea8f1a363cb
FAIL (2026-02-24 19:15:20 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 510.558264ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
14 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX..............................................]
duration:
174.431237ms
trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 19:15:18 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 174.45915ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
24.876574ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Xss-Protection=1; mode=block
Vary=Origin
X-Amz-Request-Id=189744B315A0934C
Date=Tue, 24 Feb 2026 19:15:14 GMT
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Request-Id=UQZZp5ZgM94
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/6b0c2160093beb54
FAIL (2026-02-24 19:15:14 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744B315A0934C</RequestId><HostId></HostId></Error>"
Duration: 24.897091ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX..........................................]
duration:
197.774724ms
trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 19:15:11 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload
Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload
Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments...
Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true
Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments...
Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments...
Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 197.800292ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXX........................................]
duration:
402.212096ms
trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:15:09 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 402.235561ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
23.778913ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Amz-Request-Id=189744B20EC33718
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 19:15:09 GMT
Accept-Ranges=bytes
Content-Type=application/xml
X-Request-Id=K9Fi1evf9ch
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Server=Storj
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/3ac0511e02eacc79
FAIL (2026-02-24 19:15:09 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744B20EC33718</RequestId><HostId></HostId></Error>"
Duration: 23.799072ms edge gateway vhost bgp eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX..........................................]
duration:
618.548257ms
trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 19:14:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 618.573443ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip:
6 out of 60 is failed (threshold=6) [......X.XXX...X.....X.......................................]
duration:
582.060011ms
trace:
https://jaeger.dev.storj.io/trace/29c8bea8f1a363cb
FAIL (2026-02-24 19:14:54 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 582.080059ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
25.278596ms
remote:
"tcp:136.0.77.3:443"
response headers:
X-Amz-Request-Id=189744ADEB988F61
Date=Tue, 24 Feb 2026 19:14:52 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
X-Request-Id=XaedT1HB75n
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Vary=Origin
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/3b4d42fa862315fe
FAIL (2026-02-24 19:14:52 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744ADEB988F61</RequestId><HostId></HostId></Error>"
Duration: 25.298262ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
21 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXX.......................................]
duration:
375.952709ms
trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:14:51 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 375.96934ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)
antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.............................................]
duration:
192.470448ms
trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 19:14:50 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 192.494913ms edge gateway us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)
antiblip:
12 out of 60 is failed (threshold=6) [XXXXXX.XXXXXX...............................................]
duration:
47.869269ms
remote:
"tcp:136.0.77.4:443"
target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt
trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 19:14:45 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 47.886602ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
18.348999ms
remote:
"tcp:45.38.24.2:443"
response headers:
Accept-Ranges=bytes
Content-Length=284
Content-Security-Policy=block-all-mixed-content
Date=Tue, 24 Feb 2026 19:14:42 GMT
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=189744ABA8158005
X-Request-Id=Dd3iE2KWcwU
X-Xss-Protection=1; mode=block
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/7eb0fbb845ee1505
FAIL (2026-02-24 19:14:42 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744ABA8158005</RequestId><HostId></HostId></Error>"
Duration: 18.363025ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX.XX........................................]
duration:
380.465603ms
trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 19:14:39 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 380.483178ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
24.030582ms
remote:
"tcp:136.0.77.3:443"
response headers:
Vary=Origin
X-Amz-Request-Id=189744AAA69DE951
X-Request-Id=RRf85V4r2hG
X-Xss-Protection=1; mode=block
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Date=Tue, 24 Feb 2026 19:14:38 GMT
Server=Storj
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222
trace:
https://jaeger.dev.storj.io/trace/3001aa860cae8d4a
FAIL (2026-02-24 19:14:38 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744AAA69DE951</RequestId><HostId></HostId></Error>"
Duration: 24.05059ms edge gateway vhost bgp us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
26.846212ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Server=Storj
Vary=Origin
X-Amz-Request-Id=189744AA4BA2D9C3
X-Request-Id=ScLtr4NkF6J
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 19:14:36 GMT
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318
trace:
https://jaeger.dev.storj.io/trace/662462a17e822cde
FAIL (2026-02-24 19:14:36 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744AA4BA2D9C3</RequestId><HostId></HostId></Error>"
Duration: 26.868665ms edge gateway vhost bgp eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)
antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.XX..........................................]
duration:
1.97306013s
trace:
https://jaeger.dev.storj.io/trace/c09458d54de96a9
FAIL (2026-02-24 19:14:31 UTC)
orbiter warning: operation: ListObjects
uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.973078797s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXX.....................................]
duration:
827.106186ms
trace:
https://jaeger.dev.storj.io/trace/7ea78b408ceac77f
FAIL (2026-02-24 19:14:31 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
1s) [noise=true , address=79.127.219.41:4948   , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919349510 (166h35m20.058333704s) [noise=true , address=79.127.219.46:4900   , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919385177 (166h35m20.058369371s) [noise=true , address=45.91.116.13:4179    , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919848713 (166h35m20.058832897s) [noise=true , address=77.90.31.19:4855     , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920149715 (166h35m20.059133899s) [noise=true , address=45.91.116.6:4985     , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920391487 (166h35m20.059375681s) [noise=true , address=45.91.116.12:4252    , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920646944 (166h35m20.059631128s) [noise=true , address=77.90.31.21:4911     , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920909065 (166h35m20.059893248s) [noise=true , address=145.79.227.35:4491   , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921156867 (166h35m20.060141051s) [noise=true , address=77.90.31.13:4636     , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921400382 (166h35m20.060384576s) [noise=true , address=193.149.164.66:4972  , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921659165 (166h35m20.060643349s) [noise=true , address=45.91.116.8:4052     , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921973843 (166h35m20.060958037s) [noise=true , address=77.90.31.16:4742     , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922281628 (166h35m20.061265822s) [noise=true , address=145.79.227.34:4939   , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922631973 (166h35m20.061616157s) [noise=true , address=145.79.227.37:4582   , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.924956486 (166h35m20.06394068s) [noise=true , address=145.79.227.14:4846   , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.926527841 (166h35m20.065512036s) [noise=true , address=145.79.227.29:4970   , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.928105218 (166h35m20.067089402s) [noise=true , address=45.91.116.14:4204    , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.929764789 (166h35m20.068748983s) [noise=true , address=77.90.31.14:4689     , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:01.012045757 (166h35m20.151029971s) [upload=146493]: Next returned nil segment
Feb 24 18:44:01.012057469 (166h35m20.151041683s) [upload=146493]: Waiting for error group managing segments...
Feb 24 18:44:01.020560936 (166h35m20.15954515s) [noise=true , address=45.91.116.8:4052     , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.022333197 (166h35m20.161317401s) [noise=true , address=79.127.219.46:4900   , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.035953132 (166h35m20.174937356s) [noise=true , address=145.79.227.35:4491   , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.036725164 (166h35m20.175709388s) [noise=true , address=45.91.116.12:4252    , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.041227315 (166h35m20.180211529s) [noise=true , address=45.91.116.6:4985     , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.044901219 (166h35m20.183885433s) [noise=true , address=45.91.116.14:4204    , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.046613308 (166h35m20.185597521s) [noise=true , address=77.90.31.16:4742     , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.049905900 (166h35m20.188890123s) [noise=true , address=77.90.31.19:4855     , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.050217330 (166h35m20.189201544s) [noise=true , address=77.90.31.13:4636     , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063062278 (166h35m20.202046492s) [noise=true , address=77.90.31.14:4689     , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063877701 (166h35m20.202861915s) [noise=true , address=45.91.116.13:4179    , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.066973164 (166h35m20.205957379s) [noise=true , address=77.90.31.21:4911     , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.093746163 (166h35m20.232730377s) [noise=true , address=145.79.227.14:4846   , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099012601 (166h35m20.237996825s) [noise=true , address=145.79.227.29:4970   , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099029282 (166h35m20.238013496s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 14 pieces
Feb 24 18:44:01.099459185 (166h35m20.2384434s) [noise=true , address=79.127.219.41:4948   , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gXNjKMdu97i8BC5fYWMiMf3FTepsmHsViuksBWNVLpraTJ1XW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099506874 (166h35m20.238491089s) [noise=true , address=79.127.219.41:4948   , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099675470 (166h35m20.238659684s) [noise=true , address=145.79.227.37:4582   , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099683645 (166h35m20.238667859s) [noise=true , address=145.79.227.37:4582   , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099865534 (166h35m20.238849749s) [noise=true , address=193.149.164.66:4972  , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128eDneuvfeZbqFp8YQhWHLb7hWrw7T3a2EJ7tzZkkYhaNq7CMT): protocol: read tcp 5.161.89.252:24006->193.149.164.66:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:44:01.099872908 (166h35m20.238857132s) [noise=true , address=193.149.164.66:4972  , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.100082470 (166h35m20.239066684s) [noise=true , address=145.79.227.34:4939   , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.100105593 (166h35m20.239089808s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 15 pieces
Feb 24 18:44:01.100170554 (166h35m20.239154778s) [seg_pos={0 0}, upload=146493]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Feb 24 18:44:01.100364717 (166h35m20.239348941s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:01.100379766 (166h35m20.23936399s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:14.739172222 (166h35m33.878156437s) [upload=146493]: Done uploading segments...
Feb 24 18:44:14.739199784 (166h35m33.878184008s) [upload=146493]: Upload finished. err: <nil>
Duration: 827.135822ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
43.426747ms
remote:
"tcp:136.0.77.3:443"
response headers:
Accept-Ranges=bytes
Content-Length=274
Server=Storj
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 19:14:31 GMT
Content-Security-Policy=block-all-mixed-content
Content-Type=application/xml
Vary=Origin
X-Amz-Request-Id=189744A92E877F76
X-Request-Id=ENvqoH29siB
target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011
trace:
https://jaeger.dev.storj.io/trace/9cfc8c3cccab457
FAIL (2026-02-24 19:14:31 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744A92E877F76</RequestId><HostId></HostId></Error>"
Duration: 43.446726ms edge gateway vhost bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)
antiblip:
21 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXX.X......................................]
duration:
170.355631ms
trace:
https://jaeger.dev.storj.io/trace/5b29a0cacadf86f0
FAIL (2026-02-24 19:14:27 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:44:31.418187254 (166h35m50.557171448s) [upload=146507]: Starting upload
Feb 24 18:44:31.418228731 (166h35m50.557212916s) [upload=146507]: Done starting upload
Feb 24 18:44:31.418274858 (166h35m50.557259042s) [upload=146507]: Uploading segments...
Feb 24 18:44:31.418305145 (166h35m50.557289339s) [upload=146507]: Got next segment. Inline: true
Feb 24 18:44:31.418308962 (166h35m50.557293156s) [upload=146507]: Waiting for error group managing segments...
Feb 24 18:44:31.418363463 (166h35m50.557347657s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:44:31.418369304 (166h35m50.557353488s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:44:31.418372259 (166h35m50.557356443s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:50.941040072 (166h36m10.080024286s) [upload=146507]: Done uploading segments...
Feb 24 18:44:50.941058296 (166h36m10.08004251s) [upload=146507]: Upload finished. err: <nil>
Duration: 170.37593ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)
antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.X.......................................]
duration:
173.989061ms
trace:
https://jaeger.dev.storj.io/trace/5383e9cc16a1cf07
FAIL (2026-02-24 19:14:27 UTC)
orbiter warning: operation: Commit
uplink: metaclient: context deadline exceeded
Duration: 174.006654ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
22 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXX......................................]
duration:
360.241438ms
trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:14:24 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 360.256095ms core uplink us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)
antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]
duration:
8.658856ms
remote:
"tcp:45.38.24.2:443"
response headers:
Content-Type=application/xml
Server=Storj
X-Request-Id=8hEakyhX3X4
Accept-Ranges=bytes
Vary=Origin
X-Amz-Request-Id=189744A742010453
X-Xss-Protection=1; mode=block
Date=Tue, 24 Feb 2026 19:14:23 GMT
Content-Length=284
Content-Security-Policy=block-all-mixed-content
target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410
trace:
https://jaeger.dev.storj.io/trace/3acf23eae21bbc47
FAIL (2026-02-24 19:14:23 UTC)
orbiter warning: unexpected status code "403 Forbidden"
"<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744A742010453</RequestId><HostId></HostId></Error>"
Duration: 8.6822ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)
antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.........................................]
duration:
195.551351ms
trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 19:14:06 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload
Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload
Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments...
Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true
Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments...
Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments...
Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 195.571087ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX.XX.......................................]
duration:
406.959235ms
trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 19:14:04 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 406.981757ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip:
24 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXX....................................]
duration:
822.700566ms
trace:
https://jaeger.dev.storj.io/trace/7ea78b408ceac77f
FAIL (2026-02-24 19:14:02 UTC)
orbiter warning: 
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
1s) [noise=true , address=79.127.219.41:4948   , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919349510 (166h35m20.058333704s) [noise=true , address=79.127.219.46:4900   , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919385177 (166h35m20.058369371s) [noise=true , address=45.91.116.13:4179    , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919848713 (166h35m20.058832897s) [noise=true , address=77.90.31.19:4855     , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920149715 (166h35m20.059133899s) [noise=true , address=45.91.116.6:4985     , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920391487 (166h35m20.059375681s) [noise=true , address=45.91.116.12:4252    , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920646944 (166h35m20.059631128s) [noise=true , address=77.90.31.21:4911     , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920909065 (166h35m20.059893248s) [noise=true , address=145.79.227.35:4491   , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921156867 (166h35m20.060141051s) [noise=true , address=77.90.31.13:4636     , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921400382 (166h35m20.060384576s) [noise=true , address=193.149.164.66:4972  , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921659165 (166h35m20.060643349s) [noise=true , address=45.91.116.8:4052     , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921973843 (166h35m20.060958037s) [noise=true , address=77.90.31.16:4742     , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922281628 (166h35m20.061265822s) [noise=true , address=145.79.227.34:4939   , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922631973 (166h35m20.061616157s) [noise=true , address=145.79.227.37:4582   , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.924956486 (166h35m20.06394068s) [noise=true , address=145.79.227.14:4846   , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.926527841 (166h35m20.065512036s) [noise=true , address=145.79.227.29:4970   , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.928105218 (166h35m20.067089402s) [noise=true , address=45.91.116.14:4204    , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.929764789 (166h35m20.068748983s) [noise=true , address=77.90.31.14:4689     , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:01.012045757 (166h35m20.151029971s) [upload=146493]: Next returned nil segment
Feb 24 18:44:01.012057469 (166h35m20.151041683s) [upload=146493]: Waiting for error group managing segments...
Feb 24 18:44:01.020560936 (166h35m20.15954515s) [noise=true , address=45.91.116.8:4052     , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.022333197 (166h35m20.161317401s) [noise=true , address=79.127.219.46:4900   , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.035953132 (166h35m20.174937356s) [noise=true , address=145.79.227.35:4491   , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.036725164 (166h35m20.175709388s) [noise=true , address=45.91.116.12:4252    , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.041227315 (166h35m20.180211529s) [noise=true , address=45.91.116.6:4985     , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.044901219 (166h35m20.183885433s) [noise=true , address=45.91.116.14:4204    , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.046613308 (166h35m20.185597521s) [noise=true , address=77.90.31.16:4742     , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.049905900 (166h35m20.188890123s) [noise=true , address=77.90.31.19:4855     , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.050217330 (166h35m20.189201544s) [noise=true , address=77.90.31.13:4636     , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063062278 (166h35m20.202046492s) [noise=true , address=77.90.31.14:4689     , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063877701 (166h35m20.202861915s) [noise=true , address=45.91.116.13:4179    , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.066973164 (166h35m20.205957379s) [noise=true , address=77.90.31.21:4911     , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.093746163 (166h35m20.232730377s) [noise=true , address=145.79.227.14:4846   , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099012601 (166h35m20.237996825s) [noise=true , address=145.79.227.29:4970   , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099029282 (166h35m20.238013496s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 14 pieces
Feb 24 18:44:01.099459185 (166h35m20.2384434s) [noise=true , address=79.127.219.41:4948   , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gXNjKMdu97i8BC5fYWMiMf3FTepsmHsViuksBWNVLpraTJ1XW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099506874 (166h35m20.238491089s) [noise=true , address=79.127.219.41:4948   , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099675470 (166h35m20.238659684s) [noise=true , address=145.79.227.37:4582   , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099683645 (166h35m20.238667859s) [noise=true , address=145.79.227.37:4582   , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099865534 (166h35m20.238849749s) [noise=true , address=193.149.164.66:4972  , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128eDneuvfeZbqFp8YQhWHLb7hWrw7T3a2EJ7tzZkkYhaNq7CMT): protocol: read tcp 5.161.89.252:24006->193.149.164.66:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:44:01.099872908 (166h35m20.238857132s) [noise=true , address=193.149.164.66:4972  , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.100082470 (166h35m20.239066684s) [noise=true , address=145.79.227.34:4939   , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.100105593 (166h35m20.239089808s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 15 pieces
Feb 24 18:44:01.100170554 (166h35m20.239154778s) [seg_pos={0 0}, upload=146493]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Feb 24 18:44:01.100364717 (166h35m20.239348941s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:01.100379766 (166h35m20.23936399s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:14.739172222 (166h35m33.878156437s) [upload=146493]: Done uploading segments...
Feb 24 18:44:14.739199784 (166h35m33.878184008s) [upload=146493]: Upload finished. err: <nil>
Duration: 822.748205ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.........................................]
duration:
611.560573ms
trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 19:14:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 611.579648ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXX.....................................]
duration:
380.853041ms
trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:13:59 UTC)
orbiter warning: 
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875   , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018   , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343   , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914   , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486   , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731   , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653   , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443   , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049   , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805     , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297     , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978   , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114    , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088   , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157   , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567   , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 380.880233ms core uplink us-select-1