Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
30 out of 60 is failed (threshold=3) [.......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.......] duration:
718.659358ms trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 18:48:27 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 718.681299ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
9.707707ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1897433CC3ED3E87 X-Request-Id=csBSUrv6pzk X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:48:26 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/15819005a7177367
FAIL (2026-02-24 18:48:26 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897433CC3ED3E87</RequestId><HostId></HostId></Error>"
Duration: 9.729016ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
8 out of 60 is failed (threshold=6) [............X.....................X......X.XXX...X.....X....] duration:
2.381970635s trace:
https://jaeger.dev.storj.io/trace/29c8bea8f1a363cb
FAIL (2026-02-24 18:48:25 UTC)
operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.382003054s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
44 out of 60 is failed (threshold=3) [...........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX....] duration:
567.129082ms trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 18:48:11 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 567.152446ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
41 out of 60 is failed (threshold=3) [.............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.....] duration:
216.996527ms trace:
https://jaeger.dev.storj.io/trace/5b29a0cacadf86f0
FAIL (2026-02-24 18:48:10 UTC)
operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:44:31.418187254 (166h35m50.557171448s) [upload=146507]: Starting upload Feb 24 18:44:31.418228731 (166h35m50.557212916s) [upload=146507]: Done starting upload Feb 24 18:44:31.418274858 (166h35m50.557259042s) [upload=146507]: Uploading segments... Feb 24 18:44:31.418305145 (166h35m50.557289339s) [upload=146507]: Got next segment. Inline: true Feb 24 18:44:31.418308962 (166h35m50.557293156s) [upload=146507]: Waiting for error group managing segments... Feb 24 18:44:31.418363463 (166h35m50.557347657s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:44:31.418369304 (166h35m50.557353488s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:44:31.418372259 (166h35m50.557356443s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:44:50.941040072 (166h36m10.080024286s) [upload=146507]: Done uploading segments... Feb 24 18:44:50.941058296 (166h36m10.08004251s) [upload=146507]: Upload finished. err: <nil>
Duration: 217.014651ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
29 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX......] duration:
1.062115095s trace:
https://jaeger.dev.storj.io/trace/7ea78b408ceac77f
FAIL (2026-02-24 18:48:10 UTC)
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
1s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919349510 (166h35m20.058333704s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919385177 (166h35m20.058369371s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919848713 (166h35m20.058832897s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920149715 (166h35m20.059133899s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920391487 (166h35m20.059375681s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920646944 (166h35m20.059631128s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920909065 (166h35m20.059893248s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921156867 (166h35m20.060141051s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921400382 (166h35m20.060384576s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921659165 (166h35m20.060643349s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921973843 (166h35m20.060958037s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922281628 (166h35m20.061265822s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922631973 (166h35m20.061616157s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.924956486 (166h35m20.06394068s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.926527841 (166h35m20.065512036s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.928105218 (166h35m20.067089402s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.929764789 (166h35m20.068748983s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:01.012045757 (166h35m20.151029971s) [upload=146493]: Next returned nil segment
Feb 24 18:44:01.012057469 (166h35m20.151041683s) [upload=146493]: Waiting for error group managing segments...
Feb 24 18:44:01.020560936 (166h35m20.15954515s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.022333197 (166h35m20.161317401s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.035953132 (166h35m20.174937356s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.036725164 (166h35m20.175709388s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.041227315 (166h35m20.180211529s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.044901219 (166h35m20.183885433s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.046613308 (166h35m20.185597521s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.049905900 (166h35m20.188890123s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.050217330 (166h35m20.189201544s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063062278 (166h35m20.202046492s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063877701 (166h35m20.202861915s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.066973164 (166h35m20.205957379s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.093746163 (166h35m20.232730377s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099012601 (166h35m20.237996825s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099029282 (166h35m20.238013496s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 14 pieces
Feb 24 18:44:01.099459185 (166h35m20.2384434s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gXNjKMdu97i8BC5fYWMiMf3FTepsmHsViuksBWNVLpraTJ1XW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099506874 (166h35m20.238491089s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099675470 (166h35m20.238659684s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099683645 (166h35m20.238667859s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099865534 (166h35m20.238849749s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128eDneuvfeZbqFp8YQhWHLb7hWrw7T3a2EJ7tzZkkYhaNq7CMT): protocol: read tcp 5.161.89.252:24006->193.149.164.66:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:44:01.099872908 (166h35m20.238857132s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.100082470 (166h35m20.239066684s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.100105593 (166h35m20.239089808s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 15 pieces
Feb 24 18:44:01.100170554 (166h35m20.239154778s) [seg_pos={0 0}, upload=146493]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Feb 24 18:44:01.100364717 (166h35m20.239348941s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:01.100379766 (166h35m20.23936399s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:14.739172222 (166h35m33.878156437s) [upload=146493]: Done uploading segments...
Feb 24 18:44:14.739199784 (166h35m33.878184008s) [upload=146493]: Upload finished. err: <nil>
Duration: 1.062136335s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.055369ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1897433886B2451A Date=Tue, 24 Feb 2026 18:48:08 GMT Content-Type=application/xml Vary=Origin X-Request-Id=MnoEhNBAYkV X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/29770dc0fb93afe4
FAIL (2026-02-24 18:48:08 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897433886B2451A</RequestId><HostId></HostId></Error>"
Duration: 25.070858ms
edge
gateway
vhost
bgp
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
43 out of 60 is failed (threshold=3) [...........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X.....] duration:
175.483391ms trace:
https://jaeger.dev.storj.io/trace/5383e9cc16a1cf07
FAIL (2026-02-24 18:48:07 UTC)
operation: Commit uplink: metaclient: context deadline exceeded
Duration: 175.507457ms
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
29 out of 60 is failed (threshold=3) [.......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX........] duration:
209.482106ms trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 18:48:05 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments... Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments... Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments... Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 209.506503ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
15 out of 60 is failed (threshold=6) [....................................XXX.XXXXXX.XXXXXX.......] duration:
61.123252ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 18:48:05 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 61.143681ms
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
25.672361ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Tue, 24 Feb 2026 18:48:05 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Amz-Request-Id=18974337D7675D97 X-Request-Id=8vuhkTfuASf Accept-Ranges=bytes Content-Length=274 Server=Storj Vary=Origin X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/8b66b47c9670b3f
FAIL (2026-02-24 18:48:05 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974337D7675D97</RequestId><HostId></HostId></Error>"
Duration: 25.701536ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
40 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXX.XX...] duration:
1.718444375s trace:
https://jaeger.dev.storj.io/trace/c09458d54de96a9
FAIL (2026-02-24 18:48:03 UTC)
operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 1.718482346s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
21.155843ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Type=application/xml Server=Storj X-Amz-Request-Id=18974336F493C6DA X-Request-Id=5EHZPw6avc1 X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content Vary=Origin Date=Tue, 24 Feb 2026 18:48:01 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/444a62ac48f1df20
FAIL (2026-02-24 18:48:01 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974336F493C6DA</RequestId><HostId></HostId></Error>"
Duration: 21.166032ms
edge
gateway
vhost
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
25 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXX......] duration:
380.462465ms trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 18:48:00 UTC)
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 380.487111ms
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
8 out of 60 is failed (threshold=6) [.............X.....................X......X.XXX...X.....X...] duration:
4.823525018s trace:
https://jaeger.dev.storj.io/trace/29c8bea8f1a363cb
FAIL (2026-02-24 18:47:55 UTC)
operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.823588948s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
42 out of 60 is failed (threshold=3) [............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX......] duration:
940.397751ms trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 18:47:52 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 940.41841ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
29 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.......] duration:
176.421795ms trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 18:47:49 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments... Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments... Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments... Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 176.436953ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.672954ms remote:
"tcp:136.0.77.3:443" response headers:
X-Xss-Protection=1; mode=block Content-Security-Policy=block-all-mixed-content X-Request-Id=Zct61P9uCPY Date=Tue, 24 Feb 2026 18:47:49 GMT Accept-Ranges=bytes Content-Length=274 Content-Type=application/xml Server=Storj Vary=Origin X-Amz-Request-Id=1897433401869894 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/55ba150b457827ad
FAIL (2026-02-24 18:47:49 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897433401869894</RequestId><HostId></HostId></Error>"
Duration: 24.685097ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
22.912115ms remote:
"tcp:136.0.77.3:443" response headers:
Date=Tue, 24 Feb 2026 18:47:45 GMT Content-Length=274 Server=Storj X-Amz-Request-Id=189743333E92D326 X-Request-Id=MyVjy8wio2c X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml Vary=Origin target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/71d2084dbeeebab8
FAIL (2026-02-24 18:47:45 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>189743333E92D326</RequestId><HostId></HostId></Error>"
Duration: 22.920981ms
edge
gateway
vhost
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
43 out of 60 is failed (threshold=3) [............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X....] duration:
179.009008ms trace:
https://jaeger.dev.storj.io/trace/5383e9cc16a1cf07
FAIL (2026-02-24 18:47:44 UTC)
operation: Commit uplink: metaclient: context deadline exceeded
Duration: 179.033864ms
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
44 out of 60 is failed (threshold=3) [............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX...] duration:
495.738371ms trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 18:47:44 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 495.756717ms
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
29 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration:
10.327066304s trace:
https://jaeger.dev.storj.io/trace/7ea78b408ceac77f
FAIL (2026-02-24 18:47:43 UTC)
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
1s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919349510 (166h35m20.058333704s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919385177 (166h35m20.058369371s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919848713 (166h35m20.058832897s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920149715 (166h35m20.059133899s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920391487 (166h35m20.059375681s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920646944 (166h35m20.059631128s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920909065 (166h35m20.059893248s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921156867 (166h35m20.060141051s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921400382 (166h35m20.060384576s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921659165 (166h35m20.060643349s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921973843 (166h35m20.060958037s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922281628 (166h35m20.061265822s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922631973 (166h35m20.061616157s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.924956486 (166h35m20.06394068s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.926527841 (166h35m20.065512036s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.928105218 (166h35m20.067089402s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.929764789 (166h35m20.068748983s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:01.012045757 (166h35m20.151029971s) [upload=146493]: Next returned nil segment
Feb 24 18:44:01.012057469 (166h35m20.151041683s) [upload=146493]: Waiting for error group managing segments...
Feb 24 18:44:01.020560936 (166h35m20.15954515s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.022333197 (166h35m20.161317401s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.035953132 (166h35m20.174937356s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.036725164 (166h35m20.175709388s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.041227315 (166h35m20.180211529s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.044901219 (166h35m20.183885433s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.046613308 (166h35m20.185597521s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.049905900 (166h35m20.188890123s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.050217330 (166h35m20.189201544s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063062278 (166h35m20.202046492s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063877701 (166h35m20.202861915s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.066973164 (166h35m20.205957379s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.093746163 (166h35m20.232730377s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099012601 (166h35m20.237996825s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099029282 (166h35m20.238013496s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 14 pieces
Feb 24 18:44:01.099459185 (166h35m20.2384434s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gXNjKMdu97i8BC5fYWMiMf3FTepsmHsViuksBWNVLpraTJ1XW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099506874 (166h35m20.238491089s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099675470 (166h35m20.238659684s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099683645 (166h35m20.238667859s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099865534 (166h35m20.238849749s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128eDneuvfeZbqFp8YQhWHLb7hWrw7T3a2EJ7tzZkkYhaNq7CMT): protocol: read tcp 5.161.89.252:24006->193.149.164.66:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:44:01.099872908 (166h35m20.238857132s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.100082470 (166h35m20.239066684s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.100105593 (166h35m20.239089808s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 15 pieces
Feb 24 18:44:01.100170554 (166h35m20.239154778s) [seg_pos={0 0}, upload=146493]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Feb 24 18:44:01.100364717 (166h35m20.239348941s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:01.100379766 (166h35m20.23936399s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:14.739172222 (166h35m33.878156437s) [upload=146493]: Done uploading segments...
Feb 24 18:44:14.739199784 (166h35m33.878184008s) [upload=146493]: Upload finished. err: <nil>
Duration: 10.327088306s
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
29.762784ms remote:
"tcp:136.0.77.3:443" response headers:
Server=Storj Vary=Origin X-Amz-Request-Id=18974332C769481B X-Request-Id=5kvJFU5e1QV X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 Date=Tue, 24 Feb 2026 18:47:43 GMT Content-Security-Policy=block-all-mixed-content Content-Type=application/xml target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2f0ee612951283c2
FAIL (2026-02-24 18:47:43 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974332C769481B</RequestId><HostId></HostId></Error>"
Duration: 29.78216ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
25 out of 60 is failed (threshold=3) [..............................XXXXXXXXXXXXXXXXXXXXXXXXX.....] duration:
17.33803535s trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 18:47:39 UTC)
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 17.338055778s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
42 out of 60 is failed (threshold=3) [.............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration:
12.368501642s trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 18:47:34 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 12.36854397s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
43 out of 60 is failed (threshold=3) [.............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X...] duration:
2.708157298s trace:
https://jaeger.dev.storj.io/trace/5383e9cc16a1cf07
FAIL (2026-02-24 18:47:27 UTC)
operation: Commit uplink: metaclient: context deadline exceeded
Duration: 2.708181123s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
29 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX......] duration:
1.62864519s trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 18:47:26 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments... Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments... Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments... Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1.628673302s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
40 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXX.XX..] duration:
3.854643996s trace:
https://jaeger.dev.storj.io/trace/c09458d54de96a9
FAIL (2026-02-24 18:47:24 UTC)
operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 3.854663143s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
30 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX......] duration:
4.278201712s trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 18:47:16 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.278223201s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
41 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X....] duration:
6.206552895s trace:
https://jaeger.dev.storj.io/trace/5b29a0cacadf86f0
FAIL (2026-02-24 18:47:14 UTC)
operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:44:31.418187254 (166h35m50.557171448s) [upload=146507]: Starting upload Feb 24 18:44:31.418228731 (166h35m50.557212916s) [upload=146507]: Done starting upload Feb 24 18:44:31.418274858 (166h35m50.557259042s) [upload=146507]: Uploading segments... Feb 24 18:44:31.418305145 (166h35m50.557289339s) [upload=146507]: Got next segment. Inline: true Feb 24 18:44:31.418308962 (166h35m50.557293156s) [upload=146507]: Waiting for error group managing segments... Feb 24 18:44:31.418363463 (166h35m50.557347657s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:44:31.418369304 (166h35m50.557353488s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:44:31.418372259 (166h35m50.557356443s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:44:50.941040072 (166h36m10.080024286s) [upload=146507]: Done uploading segments... Feb 24 18:44:50.941058296 (166h36m10.08004251s) [upload=146507]: Upload finished. err: <nil>
Duration: 6.206577531s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
8.800441ms remote:
"tcp:45.38.24.2:443" response headers:
Accept-Ranges=bytes Content-Length=284 Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=1897432B7F794B91 Content-Type=application/xml Server=Storj X-Request-Id=V8ChMmn6oVF X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:47:12 GMT target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/424aa68873be8d5a
FAIL (2026-02-24 18:47:12 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897432B7F794B91</RequestId><HostId></HostId></Error>"
Duration: 8.825027ms
edge
gateway
vhost
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
8 out of 60 is failed (threshold=6) [..............X.....................X......X.XXX...X.....X..] duration:
699.666722ms trace:
https://jaeger.dev.storj.io/trace/29c8bea8f1a363cb
FAIL (2026-02-24 18:47:09 UTC)
operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 699.686971ms
core
uplink
us-select-1
us1-placement-20
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
23.293819ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Length=274 Content-Security-Policy=block-all-mixed-content Server=Storj X-Amz-Request-Id=1897432923753C09 X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Type=application/xml Vary=Origin X-Request-Id=WNnVWEtdxAK Date=Tue, 24 Feb 2026 18:47:02 GMT target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/12fba6a06d5ee03
FAIL (2026-02-24 18:47:02 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897432923753C09</RequestId><HostId></HostId></Error>"
Duration: 23.308886ms
edge
gateway
vhost
bgp
ap1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
30 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration:
26.235350006s trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 18:47:02 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 26.235365355s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
25 out of 60 is failed (threshold=3) [...............................XXXXXXXXXXXXXXXXXXXXXXXXX....] duration:
15.965814684s trace:
https://jaeger.dev.storj.io/trace/7b154e70da6a7540
FAIL (2026-02-24 18:47:01 UTC)
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Feb 24 18:41:57.999131463 (166h33m17.138115677s) [upload=146474]: Starting upload
Feb 24 18:41:57.999198959 (166h33m17.138183174s) [upload=146474]: Done starting upload
Feb 24 18:41:57.999328141 (166h33m17.138312335s) [upload=146474]: Uploading segments...
Feb 24 18:41:57.999615107 (166h33m17.138599331s) [upload=146474]: Got next segment. Inline: false
Feb 24 18:41:57.999672624 (166h33m17.138656837s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Feb 24 18:41:57.999678475 (166h33m17.138662688s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Feb 24 18:42:09.429844419 (166h33m28.568828603s) [seg_pos={0 0}, upload=146474]: Begin upload segment...
Feb 24 18:42:09.429878984 (166h33m28.568863178s) [seg_pos={0 0}, upload=146474]: Done begin upload segment.
Feb 24 18:42:09.429901105 (166h33m28.568885299s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.429935218 (166h33m28.568919403s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430230660 (166h33m28.569214854s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430492840 (166h33m28.569477024s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430750783 (166h33m28.569734967s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.430991071 (166h33m28.569975256s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431233163 (166h33m28.570217357s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431551629 (166h33m28.570535813s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.431839126 (166h33m28.57082332s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.433266051 (166h33m28.572250245s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.434446958 (166h33m28.573431142s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.435448058 (166h33m28.574432252s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.436699445 (166h33m28.575683639s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.438093540 (166h33m28.577077734s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439307297 (166h33m28.578291481s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.439761746 (166h33m28.57874594s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Uploading piece...
Feb 24 18:42:09.518930921 (166h33m28.657915115s) [upload=146474]: Next returned nil segment
Feb 24 18:42:09.518940428 (166h33m28.657924612s) [upload=146474]: Waiting for error group managing segments...
Feb 24 18:42:09.528008379 (166h33m28.666992563s) [noise=true , address=145.79.227.15:4875 , piece_id=FXYLYOG4Y2MQ5NKOYUVPKZU7NOIECZGBAQT5B5WTYGHJ7TQ54C4A, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528221628 (166h33m28.667205812s) [noise=true , address=145.79.227.39:4018 , piece_id=3QEOPGVK32JLEJV2P4HVZY763WAZCMBKFKRKYKAKW2RUZIAUXODQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.528377569 (166h33m28.667361753s) [noise=true , address=145.79.227.49:4343 , piece_id=HJMNJUJ62JDEKJH55MG4ARTKENXN6ENSAB6SO2VXXCXF7CSGS6PQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.529310872 (166h33m28.668295066s) [noise=true , address=145.79.227.16:4914 , piece_id=LOH6G33NOTSPX2EHGYPSEXHCR2VLUWRR2BYRZO5KATQSN3KUTTZA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.531061212 (166h33m28.670045397s) [noise=true , address=145.79.227.35:4486 , piece_id=D6SHML7OT3YNTWYLFOQWBDLUZCBOE3HIU4E7N2F7SLGOGCUQ5RMQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.533467337 (166h33m28.672451532s) [noise=true , address=145.79.227.11:4731 , piece_id=MX5CYRWIYNI55NDKVMWGA3AFS2LMUPUU34246CNIBA24BWDVARIQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.540788244 (166h33m28.679772438s) [noise=true , address=145.79.227.26:4653 , piece_id=NR3KMDIWN4WZM7ASUFHNBJJZPOI5IZJJLWTEZO6IYMRYMA4IO2TQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.541335998 (166h33m28.680320192s) [noise=true , address=145.79.227.20:4443 , piece_id=MYRORKSVAKD76XH6EJ7NVP5P5YNQ7TLESLF2LAA22B6PH5SHTQCQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.542170426 (166h33m28.68115462s) [noise=true , address=145.79.227.40:4049 , piece_id=NPRJTV5UJRTE52IDTVHMFXJD7CYR2I5C2ZFLUJVAVD6ZUZMVZNAQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.543683784 (166h33m28.682667968s) [noise=true , address=77.90.31.18:4805 , piece_id=6VL6GAR26VPUFXNMERHUYB746PA72NZDA7LTJU3CHSRGV6EYPWDQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.545376767 (166h33m28.684360961s) [noise=true , address=45.91.116.5:4297 , piece_id=WZJLLLQIUTPKW247TATRLH5K425MX2ZD76JNGJQT4KME7AHV2FFA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.546176590 (166h33m28.685160784s) [noise=true , address=145.79.227.38:4978 , piece_id=DZ3YISF75444FUUJGNDVG3SPZSWOIRJEVZYAKTCG73D7KIYXOXRQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549820388 (166h33m28.688804572s) [noise=true , address=145.79.227.2:4114 , piece_id=RRA45YDH5ZDU4CH5CTNQMKWPFENHYDEGE7V3NKLJ3LRXGFQORL5Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: <nil>
Feb 24 18:42:09.549827611 (166h33m28.688811795s) [seg_pos={0 0}, upload=146474]: Satisfied cohort requirements after 13 pieces
Feb 24 18:42:09.549977892 (166h33m28.688962086s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284h6cPNVXJYMkSekGQVw8b7p89tkhpmgYLxTTYUDu2J7Wadoj): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.549983733 (166h33m28.688967917s) [noise=true , address=145.79.227.41:4088 , piece_id=S25UWWCAVJUXYEGMU45PHVTQX4L5BRFAKEIHDQD426UYI5XOEZIA, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550007498 (166h33m28.688991692s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZrzADk2mKG4R9tjxUKjQeJvb4WmfjLksGFyvstHRfYbBC7XNz): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550013860 (166h33m28.688998044s) [noise=true , address=145.79.227.43:4157 , piece_id=WM3UGYNXPAYIWMZT3DXFLV44LWGMAKHN7YUWG4A2HOO26HSPCGKQ, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550076105 (166h33m28.689060299s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Feb 24 18:42:09.550081025 (166h33m28.689065219s) [noise=true , address=145.79.227.37:4567 , piece_id=KLDMATQWJ5BJBN6EH76Q27YKWK6MFT74AAR543RYW2NX6YBHCO7Q, seg_pos={0 0}, upload=146474]: Long tail cancellation due to optimal threshold
Feb 24 18:42:09.550112364 (166h33m28.689096558s) [seg_pos={0 0}, upload=146474]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Feb 24 18:42:09.550210447 (166h33m28.689194631s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:42:09.550214775 (166h33m28.689198959s) [upload=146474]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:43:51.977860968 (166h35m11.116845182s) [upload=146474]: Done uploading segments...
Feb 24 18:43:51.977945004 (166h35m11.116929219s) [upload=146474]: Upload finished. err: metaclient: context deadline exceeded
Duration: 15.965835744s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
15 out of 60 is failed (threshold=6) [.....................................XXX.XXXXXX.XXXXXX......] duration:
3.586572255s remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 18:46:58 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 3.586596641s
edge
linksharing
bgp
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
42 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX....] duration:
13.607567018s trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 18:46:57 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 13.607595311s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
44 out of 60 is failed (threshold=3) [.............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX..] duration:
15.790553276s trace:
https://jaeger.dev.storj.io/trace/4c427ad68ce4a878
FAIL (2026-02-24 18:46:50 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 15.790602868s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)antiblip:
29 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.....] duration:
20.991528158s trace:
https://jaeger.dev.storj.io/trace/2d0954cf9daf2bbb
FAIL (2026-02-24 18:46:46 UTC)
operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:42:00.490044390 (166h33m19.629028604s) [upload=146475]: Starting upload Feb 24 18:42:00.490207464 (166h33m19.629191679s) [upload=146475]: Done starting upload Feb 24 18:42:00.490279810 (166h33m19.629264024s) [upload=146475]: Uploading segments... Feb 24 18:42:00.490360300 (166h33m19.629344514s) [upload=146475]: Got next segment. Inline: true Feb 24 18:42:00.490367984 (166h33m19.629352198s) [upload=146475]: Waiting for error group managing segments... Feb 24 18:42:00.490436152 (166h33m19.629420366s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:42:00.490442564 (166h33m19.629426788s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:42:00.490447063 (166h33m19.629431276s) [upload=146475]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:43:00.472138274 (166h34m19.611122487s) [upload=146475]: Done uploading segments... Feb 24 18:43:00.472188278 (166h34m19.611172491s) [upload=146475]: Upload finished. err: metaclient: context deadline exceeded
Duration: 20.991543137s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
43 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X..] duration:
11.455555995s trace:
https://jaeger.dev.storj.io/trace/5383e9cc16a1cf07
FAIL (2026-02-24 18:46:41 UTC)
operation: Commit uplink: metaclient: context deadline exceeded
Duration: 11.45558535s
core
uplink
us1
|
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
13.155247ms remote:
"tcp:45.38.24.2:443" response headers:
Content-Length=284 Content-Type=application/xml Server=Storj X-Request-Id=igkR6wMkFix X-Xss-Protection=1; mode=block Date=Tue, 24 Feb 2026 18:46:36 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Vary=Origin X-Amz-Request-Id=18974323243B4F8D target:
https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 trace:
https://jaeger.dev.storj.io/trace/3fc37aa4e87dde57
FAIL (2026-02-24 18:46:36 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974323243B4F8D</RequestId><HostId></HostId></Error>"
Duration: 13.174543ms
edge
gateway
vhost
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)antiblip:
15 out of 60 is failed (threshold=6) [......................................XXX.XXXXXX.XXXXXX.....] duration:
3.694084495s remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/6c3b9ac24855cb84
FAIL (2026-02-24 18:46:35 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 3.694206002s
edge
linksharing
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.eu1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
28.308788ms remote:
"tcp:136.0.77.3:443" response headers:
Vary=Origin X-Amz-Request-Id=18974322D174BD98 X-Request-Id=2nd9sTbxNNS Date=Tue, 24 Feb 2026 18:46:35 GMT Accept-Ranges=bytes Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Xss-Protection=1; mode=block Content-Length=274 Server=Storj target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwhnbh22a7huxgm5mpnu45kaahuq&Signature=gznnRNzM%2FpTrDIdAeC%2Bpz3LKg0A%3D&Expires=1771549318 trace:
https://jaeger.dev.storj.io/trace/636ee0c736c665d0
FAIL (2026-02-24 18:46:35 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974322D174BD98</RequestId><HostId></HostId></Error>"
Duration: 28.329195ms
edge
gateway
vhost
bgp
eu1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
24.882495ms remote:
"tcp:136.0.77.3:443" response headers:
Accept-Ranges=bytes Server=Storj Vary=Origin X-Amz-Request-Id=18974322AA6D108F Date=Tue, 24 Feb 2026 18:46:34 GMT Content-Length=274 Content-Security-Policy=block-all-mixed-content Content-Type=application/xml X-Request-Id=PYPjATJn27N X-Xss-Protection=1; mode=block target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 trace:
https://jaeger.dev.storj.io/trace/199198e2a89a0564
FAIL (2026-02-24 18:46:34 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>18974322AA6D108F</RequestId><HostId></HostId></Error>"
Duration: 24.934543ms
edge
gateway
vhost
bgp
us1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
34.281965ms remote:
"tcp:136.0.77.3:443" response headers:
Content-Security-Policy=block-all-mixed-content Server=Storj Vary=Origin X-Request-Id=2FqkTttVt8F Date=Tue, 24 Feb 2026 18:46:32 GMT Content-Type=application/xml X-Amz-Request-Id=1897432242233C8B X-Xss-Protection=1; mode=block Accept-Ranges=bytes Content-Length=274 target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/58eff9faac333105
FAIL (2026-02-24 18:46:32 UTC)
orbiter warning: unexpected status code "403 Forbidden" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>AccessDenied</Code><Message>Request has expired</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>1897432242233C8B</RequestId><HostId></HostId></Error>"
Duration: 34.301543ms
edge
gateway
vhost
bgp
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
41 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X...] duration:
5.161361785s trace:
https://jaeger.dev.storj.io/trace/5b29a0cacadf86f0
FAIL (2026-02-24 18:46:28 UTC)
operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Feb 24 18:44:31.418187254 (166h35m50.557171448s) [upload=146507]: Starting upload Feb 24 18:44:31.418228731 (166h35m50.557212916s) [upload=146507]: Done starting upload Feb 24 18:44:31.418274858 (166h35m50.557259042s) [upload=146507]: Uploading segments... Feb 24 18:44:31.418305145 (166h35m50.557289339s) [upload=146507]: Got next segment. Inline: true Feb 24 18:44:31.418308962 (166h35m50.557293156s) [upload=146507]: Waiting for error group managing segments... Feb 24 18:44:31.418363463 (166h35m50.557347657s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Feb 24 18:44:31.418369304 (166h35m50.557353488s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Feb 24 18:44:31.418372259 (166h35m50.557356443s) [upload=146507]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Feb 24 18:44:50.941040072 (166h36m10.080024286s) [upload=146507]: Done uploading segments... Feb 24 18:44:50.941058296 (166h36m10.08004251s) [upload=146507]: Upload finished. err: <nil>
Duration: 5.1614016s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
29 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX....] duration:
1.073674792s trace:
https://jaeger.dev.storj.io/trace/7ea78b408ceac77f
FAIL (2026-02-24 18:46:26 UTC)
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
1s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919349510 (166h35m20.058333704s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919385177 (166h35m20.058369371s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.919848713 (166h35m20.058832897s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920149715 (166h35m20.059133899s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920391487 (166h35m20.059375681s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920646944 (166h35m20.059631128s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.920909065 (166h35m20.059893248s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921156867 (166h35m20.060141051s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921400382 (166h35m20.060384576s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921659165 (166h35m20.060643349s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.921973843 (166h35m20.060958037s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922281628 (166h35m20.061265822s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.922631973 (166h35m20.061616157s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.924956486 (166h35m20.06394068s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.926527841 (166h35m20.065512036s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.928105218 (166h35m20.067089402s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:00.929764789 (166h35m20.068748983s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Uploading piece...
Feb 24 18:44:01.012045757 (166h35m20.151029971s) [upload=146493]: Next returned nil segment
Feb 24 18:44:01.012057469 (166h35m20.151041683s) [upload=146493]: Waiting for error group managing segments...
Feb 24 18:44:01.020560936 (166h35m20.15954515s) [noise=true , address=45.91.116.8:4052 , piece_id=OSFGARHZ4RC3GB6TGL57OUS6G5HML7HBLEPVMQQM3HWJO6UBTA7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.022333197 (166h35m20.161317401s) [noise=true , address=79.127.219.46:4900 , piece_id=E6Z43XUEXNCGI76F2Z7WDCK6E5CZMMSBN4NE3VQKT3HAFS2Y7QSQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.035953132 (166h35m20.174937356s) [noise=true , address=145.79.227.35:4491 , piece_id=QRWSMM5V6XF75ORBT5E4EONQHZ3BSRKTRJKF5R2OYM7RHWUYOETQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.036725164 (166h35m20.175709388s) [noise=true , address=45.91.116.12:4252 , piece_id=ZZ4SDZDF5B7KGQXX2CR6KVKSCCJGWYI327TDMKVEV6VVJNVHFVGA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.041227315 (166h35m20.180211529s) [noise=true , address=45.91.116.6:4985 , piece_id=GGC7CI62BZZB56QJKHL7MZVPBZCNJKGG3XN5JYUD3WB3C3G67XIA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.044901219 (166h35m20.183885433s) [noise=true , address=45.91.116.14:4204 , piece_id=XQQZ4DIUCLHLQILPOYN2RL7ON5VRJCFS622OJC6Y4Y7RSG6B4W7Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.046613308 (166h35m20.185597521s) [noise=true , address=77.90.31.16:4742 , piece_id=UQLVEP6CSK7AQNGD63UP2CPV7AIA2NIZ4RZXCPOZXJPOBRM7TH6Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.049905900 (166h35m20.188890123s) [noise=true , address=77.90.31.19:4855 , piece_id=ZF7VMBTCLI2YMUMUL3DNJ2UPVIN5WNWM5CVR56T6F3P6LMAAZZCQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.050217330 (166h35m20.189201544s) [noise=true , address=77.90.31.13:4636 , piece_id=UQ5MUJ3MVVLEGB7GH5BXC6XWZY7U2OKSXX3WFOD6OHZYFPOBNKJQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063062278 (166h35m20.202046492s) [noise=true , address=77.90.31.14:4689 , piece_id=FS3QNBO7K3N3ZIZYPV57AAIMJQ33NKCGT4GBCA7THC5QDEO7YEQQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.063877701 (166h35m20.202861915s) [noise=true , address=45.91.116.13:4179 , piece_id=OQ624U2HU36XD77IKJBP6Z6B3QHEOWW3MLQLOHDTK34N7C25A3FA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.066973164 (166h35m20.205957379s) [noise=true , address=77.90.31.21:4911 , piece_id=PAC75B4GQR7ZGOONLLG3QZHM62WBGPQGUDJ3QSOHUHBQSGWAVC5Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.093746163 (166h35m20.232730377s) [noise=true , address=145.79.227.14:4846 , piece_id=QXT2YVIRCQT7HKZKTJR4BRQRNTWGAFYVQF4YZEIKCRA5YY77ZLJA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099012601 (166h35m20.237996825s) [noise=true , address=145.79.227.29:4970 , piece_id=KENFISHR4HYVPMBMD33G2E5G6LARJZN3NQYOZ4KKJ7ODMLNZQT2Q, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.099029282 (166h35m20.238013496s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 14 pieces
Feb 24 18:44:01.099459185 (166h35m20.2384434s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gXNjKMdu97i8BC5fYWMiMf3FTepsmHsViuksBWNVLpraTJ1XW): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099506874 (166h35m20.238491089s) [noise=true , address=79.127.219.41:4948 , piece_id=AKMCPMBJICKLCUO5EDO2VTOGHO3EOBF2ZGUZOVE2JBAJZ7AL4GKQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099675470 (166h35m20.238659684s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129o91j97t4V5AjaouCCy2wDuHgwF94iQiJh2h9ux1aFo7AVCSn): protocol: expected piece hash; context canceled; EOF
Feb 24 18:44:01.099683645 (166h35m20.238667859s) [noise=true , address=145.79.227.37:4582 , piece_id=3KJKXV6QUMY2WXQQ65MF6PR3IKXQ6BGHPBOCCRMBG3BPGCSQIXEQ, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.099865534 (166h35m20.238849749s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128eDneuvfeZbqFp8YQhWHLb7hWrw7T3a2EJ7tzZkkYhaNq7CMT): protocol: read tcp 5.161.89.252:24006->193.149.164.66:4972: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Feb 24 18:44:01.099872908 (166h35m20.238857132s) [noise=true , address=193.149.164.66:4972 , piece_id=22NWJODMK6GYWQQRUGQDTR7AMOBFXSNK5VE26N75OKEY36YS2CVA, seg_pos={0 0}, upload=146493]: Long tail cancellation due to optimal threshold
Feb 24 18:44:01.100082470 (166h35m20.239066684s) [noise=true , address=145.79.227.34:4939 , piece_id=KFYQXKIMP5FUYCXO5ADS322HOPEBT33QZ7ZBIYXLUGEXMVVEXLMA, seg_pos={0 0}, upload=146493]: Done uploading piece. err: <nil>
Feb 24 18:44:01.100105593 (166h35m20.239089808s) [seg_pos={0 0}, upload=146493]: Satisfied cohort requirements after 15 pieces
Feb 24 18:44:01.100170554 (166h35m20.239154778s) [seg_pos={0 0}, upload=146493]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Feb 24 18:44:01.100364717 (166h35m20.239348941s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Feb 24 18:44:01.100379766 (166h35m20.23936399s) [upload=146493]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Feb 24 18:44:14.739172222 (166h35m33.878156437s) [upload=146493]: Done uploading segments...
Feb 24 18:44:14.739199784 (166h35m33.878184008s) [upload=146493]: Upload finished. err: <nil>
Duration: 1.073708676s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
42 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX...] duration:
8.447129016s trace:
https://jaeger.dev.storj.io/trace/6973a18e73267103
FAIL (2026-02-24 18:46:24 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.447151688s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
30 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX....] duration:
9.163270265s trace:
https://jaeger.dev.storj.io/trace/51430d55a27ab7ca
FAIL (2026-02-24 18:46:21 UTC)
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 9.163324958s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
40 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXX.XX.] duration:
6.868422564s trace:
https://jaeger.dev.storj.io/trace/c09458d54de96a9
FAIL (2026-02-24 18:46:20 UTC)
operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 6.86843637s
core
uplink
us1
|