Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
9 out of 60 is failed (threshold=6) [XXX.XXXXXX..................................................] duration:
42.128453ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 19:16:28 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 42.152838ms
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
12 out of 60 is failed (threshold=3) [XXXXXXXXXXXX................................................] duration:
172.869818ms trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 19:16:26 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 172.890167ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.XX..........................................] duration:
457.906144ms trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 19:16:20 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 457.943725ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.965891ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=189744C184808B5D Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content X-Request-Id=jF5uer4JsM X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:16:16 GMT Content-Type=application/xml Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/434d410eb935fe31
FAIL (2026-02-24 19:16:16 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744C184808B5D</RequestId><HostId></HostId></Error>"
Duration: 24.987381ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.511144ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=189744C10D9ADE93 X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:16:14 GMT Content-Length=274 Content-Type=application/xml X-Request-Id=D41P2Esqq3s Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/5dbcfe3475b8f99d
FAIL (2026-02-24 19:16:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744C10D9ADE93</RequestId><HostId></HostId></Error>"
Duration: 22.525882ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX.X........................................] duration:
203.874569ms trace:
https://jaeger.dev.storj.io/trace/5b29a0cacadf86f0
FAIL (2026-02-24 19:16:07 UTC)
orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:44:31.418187254 (166h35m50.557171448s) [upload=146507]: Starting upload Feb 24 18:44:31.418228731 (166h35m50.557212916s) [upload=146507]: Done starting upload Feb 24 18:44:31.418274858 (166h35m50.557259042s) [upload=146507]: Uploading segments... Feb 24 18:44:31.418305145 (166h35m50.557289339s) [upload=146507]: Got next segment. Inline: true Feb 24 18:44:31.418308962 (166h35m50.557293156s) [upload=146507]: Waiting for error group managing segments... Feb 24 18:44:31.418363463 (166h35m50.557347657s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:44:31.418369304 (166h35m50.557353488s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:44:31.418372259 (166h35m50.557356443s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:44:50.941040072 (166h36m10.080024286s) [upload=146507]: Done uploading segments... Feb 24 18:44:50.941058296 (166h36m10.08004251s) [upload=146507]: Upload finished. err: <nil>
Duration: 203.888246ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX...........................................] duration:
578.154875ms trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 19:16:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 578.174413ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.........................................] duration:
375.090981ms trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:16:05 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 375.111188ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.502453ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=189744BDE407903C X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:16:00 GMT Accept-Ranges=bytes Content-Type=application/xml Server=Storj X-Request-Id=8WogGcbAqkh Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2605b4a259a840f6
FAIL (2026-02-24 19:16:00 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744BDE407903C</RequestId><HostId></HostId></Error>"
Duration: 25.52195ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
10 out of 60 is failed (threshold=6) [XXXX.XXXXXX.................................................] duration:
42.288282ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 19:15:58 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 42.307907ms
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXX.XX.........................................] duration:
350.309965ms trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 19:15:53 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 350.330703ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX.XX............................................] duration:
1.710928408s trace:
https://jaeger.dev.storj.io/trace/c09458d54de96a9
FAIL (2026-02-24 19:15:52 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.710947764s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
6 out of 60 is failed (threshold=6) [....X.XXX...X.....X.........................................] duration:
516.653546ms trace:
https://jaeger.dev.storj.io/trace/29c8bea8f1a363cb
FAIL (2026-02-24 19:15:49 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 516.673744ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX...........................................] duration:
223.026159ms trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 19:15:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments... Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments... Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments... Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 223.048852ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
22 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXX......................................] duration:
770.648195ms trace:
https://jaeger.dev.storj.io/trace/7ea78b408ceac77f
FAIL (2026-02-24 19:15:45 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
1s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919349510 (166h35m20.058333704s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919385177 (166h35m20.058369371s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919848713 (166h35m20.058832897s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920149715 (166h35m20.059133899s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920391487 (166h35m20.059375681s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920646944 (166h35m20.059631128s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920909065 (166h35m20.059893248s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921156867 (166h35m20.060141051s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921400382 (166h35m20.060384576s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921659165 (166h35m20.060643349s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921973843 (166h35m20.060958037s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922281628 (166h35m20.061265822s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922631973 (166h35m20.061616157s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.924956486 (166h35m20.06394068s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.926527841 (166h35m20.065512036s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.928105218 (166h35m20.067089402s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.929764789 (166h35m20.068748983s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:01.012045757 (166h35m20.151029971s) [upload=146493]: Next returned nil segment
Feb 24 18:44:01.012057469 (166h35m20.151041683s) [upload=146493]: Waiting for error group managing segments...
Feb 24 18:44:01.020560936 (166h35m20.15954515s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.022333197 (166h35m20.161317401s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.035953132 (166h35m20.174937356s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.036725164 (166h35m20.175709388s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.041227315 (166h35m20.180211529s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.044901219 (166h35m20.183885433s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.046613308 (166h35m20.185597521s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.049905900 (166h35m20.188890123s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.050217330 (166h35m20.189201544s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063062278 (166h35m20.202046492s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063877701 (166h35m20.202861915s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.066973164 (166h35m20.205957379s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.093746163 (166h35m20.232730377s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099012601 (166h35m20.237996825s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099029282 (166h35m20.238013496s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 14 pieces
Feb 24 18:44:01.099459185 (166h35m20.2384434s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gXNjKMdu97i8BC5fYWMiMf3FTepsmHsViuksBWNVLpraTJ1XW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099506874 (166h35m20.238491089s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099675470 (166h35m20.238659684s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099683645 (166h35m20.238667859s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099865534 (166h35m20.238849749s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128eDneuvfeZbqFp8YQhWHLb7hWrw7T3a2EJ7tzZkkYhaNq7CMT): protocol: read tcp 5.161.89.252:24006->193.149.164.66:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:44:01.099872908 (166h35m20.238857132s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.100082470 (166h35m20.239066684s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.100105593 (166h35m20.239089808s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 15 pieces
Feb 24 18:44:01.100170554 (166h35m20.239154778s) [seg_pos={0 0}, upload=146493]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Feb 24 18:44:01.100364717 (166h35m20.239348941s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:01.100379766 (166h35m20.23936399s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:14.739172222 (166h35m33.878156437s) [upload=146493]: Done uploading segments...
Feb 24 18:44:14.739199784 (166h35m33.878184008s) [upload=146493]: Upload finished. err: <nil>
Duration: 770.66238ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.481706ms remote:
"tcp:45.38.24.2:443" response headers:
Server=Storj X-Amz-Request-Id=189744BA5FB95C9E X-Request-Id=ibg7f7K7VFn X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:15:45 GMT Content-Length=284 Content-Type=application/xml Vary=Origin Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3b5214d3b9a8a4bd
FAIL (2026-02-24 19:15:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744BA5FB95C9E</RequestId><HostId></HostId></Error>"
Duration: 24.491753ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
31.691655ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Type=application/xml Server=Storj X-Amz-Request-Id=189744BA5EEA5CF4 Date=Tue, 24 Feb 2026 19:15:45 GMT Accept-Ranges=bytes Content-Length=274 Vary=Origin X-Request-Id=CdtfyH2jt1g X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/aa14c44ef3196ff
FAIL (2026-02-24 19:15:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744BA5EEA5CF4</RequestId><HostId></HostId></Error>"
Duration: 31.703628ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX.X........................................] duration:
190.392154ms trace:
https://jaeger.dev.storj.io/trace/5383e9cc16a1cf07
FAIL (2026-02-24 19:15:41 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 190.420897ms
core
uplink
us1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
11 out of 60 is failed (threshold=6) [XXXXX.XXXXXX................................................] duration:
74.987638ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 19:15:38 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 75.008587ms
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
13 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX...............................................] duration:
193.533792ms trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 19:15:36 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 193.562145ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
16 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX.XX...........................................] duration:
1.707819069s trace:
https://jaeger.dev.storj.io/trace/c09458d54de96a9
FAIL (2026-02-24 19:15:30 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.70784084s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.X.......................................] duration:
167.961449ms trace:
https://jaeger.dev.storj.io/trace/5b29a0cacadf86f0
FAIL (2026-02-24 19:15:29 UTC)
orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:44:31.418187254 (166h35m50.557171448s) [upload=146507]: Starting upload Feb 24 18:44:31.418228731 (166h35m50.557212916s) [upload=146507]: Done starting upload Feb 24 18:44:31.418274858 (166h35m50.557259042s) [upload=146507]: Uploading segments... Feb 24 18:44:31.418305145 (166h35m50.557289339s) [upload=146507]: Got next segment. Inline: true Feb 24 18:44:31.418308962 (166h35m50.557293156s) [upload=146507]: Waiting for error group managing segments... Feb 24 18:44:31.418363463 (166h35m50.557347657s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:44:31.418369304 (166h35m50.557353488s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:44:31.418372259 (166h35m50.557356443s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:44:50.941040072 (166h36m10.080024286s) [upload=146507]: Done uploading segments... Feb 24 18:44:50.941058296 (166h36m10.08004251s) [upload=146507]: Upload finished. err: <nil>
Duration: 167.9775ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
6 out of 60 is failed (threshold=6) [.....X.XXX...X.....X........................................] duration:
510.539188ms trace:
https://jaeger.dev.storj.io/trace/29c8bea8f1a363cb
FAIL (2026-02-24 19:15:20 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 510.558264ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
14 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX..............................................] duration:
174.431237ms trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 19:15:18 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 174.45915ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.876574ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Vary=Origin X-Amz-Request-Id=189744B315A0934C Date=Tue, 24 Feb 2026 19:15:14 GMT Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=UQZZp5ZgM94 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/6b0c2160093beb54
FAIL (2026-02-24 19:15:14 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744B315A0934C</RequestId><HostId></HostId></Error>"
Duration: 24.897091ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX..........................................] duration:
197.774724ms trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 19:15:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments... Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments... Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments... Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 197.800292ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXX........................................] duration:
402.212096ms trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:15:09 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 402.235561ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.778913ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=189744B20EC33718 X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:15:09 GMT Accept-Ranges=bytes Content-Type=application/xml X-Request-Id=K9Fi1evf9ch Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3ac0511e02eacc79
FAIL (2026-02-24 19:15:09 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744B20EC33718</RequestId><HostId></HostId></Error>"
Duration: 23.799072ms
edge
gateway
vhost
bgp
eu1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
18 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX..........................................] duration:
618.548257ms trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 19:14:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 618.573443ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
6 out of 60 is failed (threshold=6) [......X.XXX...X.....X.......................................] duration:
582.060011ms trace:
https://jaeger.dev.storj.io/trace/29c8bea8f1a363cb
FAIL (2026-02-24 19:14:54 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 582.080059ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.278596ms remote:
"tcp:136.0.77.3:443" response headers:
X-Amz-Request-Id=189744ADEB988F61 Date=Tue, 24 Feb 2026 19:14:52 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj X-Request-Id=XaedT1HB75n X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/3b4d42fa862315fe
FAIL (2026-02-24 19:14:52 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744ADEB988F61</RequestId><HostId></HostId></Error>"
Duration: 25.298262ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
21 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXX.......................................] duration:
375.952709ms trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:14:51 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 375.96934ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
15 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.............................................] duration:
192.470448ms trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 19:14:50 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 192.494913ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
12 out of 60 is failed (threshold=6) [XXXXXX.XXXXXX...............................................] duration:
47.869269ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 19:14:45 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 47.886602ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
18.348999ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Date=Tue, 24 Feb 2026 19:14:42 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189744ABA8158005 X-Request-Id=Dd3iE2KWcwU X-Xss-Protection=1; mode=block target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/7eb0fbb845ee1505
FAIL (2026-02-24 19:14:42 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744ABA8158005</RequestId><HostId></HostId></Error>"
Duration: 18.363025ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXX.XX........................................] duration:
380.465603ms trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 19:14:39 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 380.483178ms
edge
gateway
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.030582ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=189744AAA69DE951 X-Request-Id=RRf85V4r2hG X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Date=Tue, 24 Feb 2026 19:14:38 GMT Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/3001aa860cae8d4a
FAIL (2026-02-24 19:14:38 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744AAA69DE951</RequestId><HostId></HostId></Error>"
Duration: 24.05059ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
26.846212ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=189744AA4BA2D9C3 X-Request-Id=ScLtr4NkF6J X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:14:36 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/662462a17e822cde
FAIL (2026-02-24 19:14:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744AA4BA2D9C3</RequestId><HostId></HostId></Error>"
Duration: 26.868665ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
17 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXX.XX..........................................] duration:
1.97306013s trace:
https://jaeger.dev.storj.io/trace/c09458d54de96a9
FAIL (2026-02-24 19:14:31 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.973078797s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXX.....................................] duration:
827.106186ms trace:
https://jaeger.dev.storj.io/trace/7ea78b408ceac77f
FAIL (2026-02-24 19:14:31 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
1s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919349510 (166h35m20.058333704s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919385177 (166h35m20.058369371s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919848713 (166h35m20.058832897s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920149715 (166h35m20.059133899s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920391487 (166h35m20.059375681s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920646944 (166h35m20.059631128s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920909065 (166h35m20.059893248s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921156867 (166h35m20.060141051s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921400382 (166h35m20.060384576s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921659165 (166h35m20.060643349s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921973843 (166h35m20.060958037s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922281628 (166h35m20.061265822s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922631973 (166h35m20.061616157s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.924956486 (166h35m20.06394068s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.926527841 (166h35m20.065512036s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.928105218 (166h35m20.067089402s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.929764789 (166h35m20.068748983s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:01.012045757 (166h35m20.151029971s) [upload=146493]: Next returned nil segment
Feb 24 18:44:01.012057469 (166h35m20.151041683s) [upload=146493]: Waiting for error group managing segments...
Feb 24 18:44:01.020560936 (166h35m20.15954515s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.022333197 (166h35m20.161317401s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.035953132 (166h35m20.174937356s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.036725164 (166h35m20.175709388s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.041227315 (166h35m20.180211529s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.044901219 (166h35m20.183885433s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.046613308 (166h35m20.185597521s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.049905900 (166h35m20.188890123s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.050217330 (166h35m20.189201544s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063062278 (166h35m20.202046492s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063877701 (166h35m20.202861915s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.066973164 (166h35m20.205957379s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.093746163 (166h35m20.232730377s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099012601 (166h35m20.237996825s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099029282 (166h35m20.238013496s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 14 pieces
Feb 24 18:44:01.099459185 (166h35m20.2384434s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gXNjKMdu97i8BC5fYWMiMf3FTepsmHsViuksBWNVLpraTJ1XW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099506874 (166h35m20.238491089s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099675470 (166h35m20.238659684s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099683645 (166h35m20.238667859s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099865534 (166h35m20.238849749s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128eDneuvfeZbqFp8YQhWHLb7hWrw7T3a2EJ7tzZkkYhaNq7CMT): protocol: read tcp 5.161.89.252:24006->193.149.164.66:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:44:01.099872908 (166h35m20.238857132s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.100082470 (166h35m20.239066684s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.100105593 (166h35m20.239089808s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 15 pieces
Feb 24 18:44:01.100170554 (166h35m20.239154778s) [seg_pos={0 0}, upload=146493]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Feb 24 18:44:01.100364717 (166h35m20.239348941s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:01.100379766 (166h35m20.23936399s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:14.739172222 (166h35m33.878156437s) [upload=146493]: Done uploading segments...
Feb 24 18:44:14.739199784 (166h35m33.878184008s) [upload=146493]: Upload finished. err: <nil>
Duration: 827.135822ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
43.426747ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Server=Storj X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:14:31 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin X-Amz-Request-Id=189744A92E877F76 X-Request-Id=ENvqoH29siB target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/9cfc8c3cccab457
FAIL (2026-02-24 19:14:31 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744A92E877F76</RequestId><HostId></HostId></Error>"
Duration: 43.446726ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
21 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXX.X......................................] duration:
170.355631ms trace:
https://jaeger.dev.storj.io/trace/5b29a0cacadf86f0
FAIL (2026-02-24 19:14:27 UTC)
orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:44:31.418187254 (166h35m50.557171448s) [upload=146507]: Starting upload Feb 24 18:44:31.418228731 (166h35m50.557212916s) [upload=146507]: Done starting upload Feb 24 18:44:31.418274858 (166h35m50.557259042s) [upload=146507]: Uploading segments... Feb 24 18:44:31.418305145 (166h35m50.557289339s) [upload=146507]: Got next segment. Inline: true Feb 24 18:44:31.418308962 (166h35m50.557293156s) [upload=146507]: Waiting for error group managing segments... Feb 24 18:44:31.418363463 (166h35m50.557347657s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:44:31.418369304 (166h35m50.557353488s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:44:31.418372259 (166h35m50.557356443s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:44:50.941040072 (166h36m10.080024286s) [upload=146507]: Done uploading segments... Feb 24 18:44:50.941058296 (166h36m10.08004251s) [upload=146507]: Upload finished. err: <nil>
Duration: 170.37593ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.X.......................................] duration:
173.989061ms trace:
https://jaeger.dev.storj.io/trace/5383e9cc16a1cf07
FAIL (2026-02-24 19:14:27 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 174.006654ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
22 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXX......................................] duration:
360.241438ms trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:14:24 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 360.256095ms
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.658856ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Type=application/xml Server=Storj X-Request-Id=8hEakyhX3X4 Accept-Ranges=bytes Vary=Origin X-Amz-Request-Id=189744A742010453 X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 19:14:23 GMT Content-Length=284 Content-Security-Policy=block-all-mixed-content target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3acf23eae21bbc47
FAIL (2026-02-24 19:14:23 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>189744A742010453</RequestId><HostId></HostId></Error>"
Duration: 8.6822ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.........................................] duration:
195.551351ms trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 19:14:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments... Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments... Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments... Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 195.571087ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
20 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXX.XX.......................................] duration:
406.959235ms trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 19:14:04 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 406.981757ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
24 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXX....................................] duration:
822.700566ms trace:
https://jaeger.dev.storj.io/trace/7ea78b408ceac77f
FAIL (2026-02-24 19:14:02 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
1s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919349510 (166h35m20.058333704s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919385177 (166h35m20.058369371s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919848713 (166h35m20.058832897s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920149715 (166h35m20.059133899s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920391487 (166h35m20.059375681s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920646944 (166h35m20.059631128s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920909065 (166h35m20.059893248s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921156867 (166h35m20.060141051s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921400382 (166h35m20.060384576s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921659165 (166h35m20.060643349s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921973843 (166h35m20.060958037s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922281628 (166h35m20.061265822s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922631973 (166h35m20.061616157s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.924956486 (166h35m20.06394068s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.926527841 (166h35m20.065512036s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.928105218 (166h35m20.067089402s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.929764789 (166h35m20.068748983s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:01.012045757 (166h35m20.151029971s) [upload=146493]: Next returned nil segment
Feb 24 18:44:01.012057469 (166h35m20.151041683s) [upload=146493]: Waiting for error group managing segments...
Feb 24 18:44:01.020560936 (166h35m20.15954515s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.022333197 (166h35m20.161317401s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.035953132 (166h35m20.174937356s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.036725164 (166h35m20.175709388s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.041227315 (166h35m20.180211529s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.044901219 (166h35m20.183885433s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.046613308 (166h35m20.185597521s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.049905900 (166h35m20.188890123s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.050217330 (166h35m20.189201544s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063062278 (166h35m20.202046492s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063877701 (166h35m20.202861915s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.066973164 (166h35m20.205957379s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.093746163 (166h35m20.232730377s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099012601 (166h35m20.237996825s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099029282 (166h35m20.238013496s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 14 pieces
Feb 24 18:44:01.099459185 (166h35m20.2384434s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gXNjKMdu97i8BC5fYWMiMf3FTepsmHsViuksBWNVLpraTJ1XW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099506874 (166h35m20.238491089s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099675470 (166h35m20.238659684s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099683645 (166h35m20.238667859s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099865534 (166h35m20.238849749s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128eDneuvfeZbqFp8YQhWHLb7hWrw7T3a2EJ7tzZkkYhaNq7CMT): protocol: read tcp 5.161.89.252:24006->193.149.164.66:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:44:01.099872908 (166h35m20.238857132s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.100082470 (166h35m20.239066684s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.100105593 (166h35m20.239089808s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 15 pieces
Feb 24 18:44:01.100170554 (166h35m20.239154778s) [seg_pos={0 0}, upload=146493]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Feb 24 18:44:01.100364717 (166h35m20.239348941s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:01.100379766 (166h35m20.23936399s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:14.739172222 (166h35m33.878156437s) [upload=146493]: Done uploading segments...
Feb 24 18:44:14.739199784 (166h35m33.878184008s) [upload=146493]: Upload finished. err: <nil>
Duration: 822.748205ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
19 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXX.........................................] duration:
611.560573ms trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 19:14:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 611.579648ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
23 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXX.....................................] duration:
380.853041ms trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 19:13:59 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 380.880233ms
core
uplink
us-select-1
|