Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [.X..X.XX....X..X..X..X.......XX.....XXXXX.....XX............] duration: 531.11424ms FAIL (2025-08-26 05:54:38 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 531.132944ms core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [..X....X....X.......................X.......................] duration: 185.934869ms remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:54:34 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 185.96168ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 11 out of 60 is failed (threshold=3) [X.....XX.XX....XX.................X...XX........X...........] duration: 192.899706ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3AEE0EB33B6A X-Request-Id=McQuPBREAb1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:46:14 GMT Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:54:28 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AEE0EB33B6A</RequestId><HostId></HostId></Error>" Duration: 192.934493ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 16 out of 60 is failed (threshold=3) [X.XX..XXX....XX......XX..XX....X............XXX.............] duration: 663.799623ms FAIL (2025-08-26 05:54:27 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 663.822278ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 26 out of 60 is failed (threshold=3) [XXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX......XX.X........] duration: 2.398085928s FAIL (2025-08-26 05:54:23 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.398123738s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [X....X...............X..X.........XX.........X.XX.X.........] duration: 238.693585ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3AFB7EA3A7A1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:47:11 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=8tjmSuZMkvh Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:54:20 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AFB7EA3A7A1</RequestId><HostId></HostId></Error>" Duration: 238.712259ms edge gateway vhost bgp us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [..X.X..X.............XX...............XX........X...........] duration: 995.478481ms FAIL (2025-08-26 05:54:12 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3AEE3B34C493, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 995.529417ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [.....X.X..XX.....X...................X.........XX...........] duration: 573.460402ms FAIL (2025-08-26 05:54:09 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:46:19.122249242 (13h42m34.347432309s) [upload=12027]: Starting upload Aug 26 05:46:19.122336606 (13h42m34.347519673s) [upload=12027]: Done starting upload Aug 26 05:46:19.122389295 (13h42m34.347572352s) [upload=12027]: Uploading segments... Aug 26 05:46:19.122426304 (13h42m34.347609352s) [upload=12027]: Got next segment. Inline: true Aug 26 05:46:19.122431003 (13h42m34.34761406s) [upload=12027]: Waiting for error group managing segments... Aug 26 05:46:19.122482891 (13h42m34.347665938s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:19.122487078 (13h42m34.347670135s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:46:19.122489442 (13h42m34.3476725s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:30.124196038 (13h42m45.349379106s) [upload=12027]: Done uploading segments... Aug 26 05:46:30.124211648 (13h42m45.349394705s) [upload=12027]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 573.482222ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [X.X.XX.XXXXX....X..X...X...X......X..XX.X.......XX..........] duration: 2.299576821s FAIL (2025-08-26 05:54:03 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:46:28.652260030 (13h42m43.877443077s) [upload=12031]: Starting upload Aug 26 05:46:28.652309312 (13h42m43.87749236s) [upload=12031]: Done starting upload Aug 26 05:46:28.652384173 (13h42m43.87756722s) [upload=12031]: Uploading segments... Aug 26 05:46:28.652505932 (13h42m43.877688979s) [upload=12031]: Got next segment. Inline: false Aug 26 05:46:28.652541158 (13h42m43.877724205s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:28.652544514 (13h42m43.877727551s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:46:40.061445530 (13h42m55.286628608s) [seg_pos={0 0}, upload=12031]: Begin upload segment... Aug 26 05:46:40.061488060 (13h42m55.286671137s) [seg_pos={0 0}, upload=12031]: Done begin upload segment. Aug 26 05:46:40.061554374 (13h42m55.286737452s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.061611752 (13h42m55.286794849s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062021513 (13h42m55.2872046s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062468782 (13h42m55.2876519s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062534026 (13h42m55.287717103s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063015901 (13h42m55.288198978s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063369004 (13h42m55.288552091s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063410292 (13h42m55.28859338s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063862080 (13h42m55.289045158s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064200546 (13h42m55.289383624s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064299062 (13h42m55.289482139s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064693774 (13h42m55.289876851s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064967658 (13h42m55.290150735s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065182031 (13h42m55.290365109s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065678393 (13h42m55.290861481s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.066367499 (13h42m55.291550586s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.166559082 (13h42m55.391742129s) [upload=12031]: Next returned nil segment Aug 26 05:46:40.166572948 (13h42m55.391755995s) [upload=12031]: Waiting for error group managing segments... Aug 26 05:46:40.173665544 (13h42m55.398848592s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.174842136 (13h42m55.400025202s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175255342 (13h42m55.400438389s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175557269 (13h42m55.400740356s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175698043 (13h42m55.400881081s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176056869 (13h42m55.401239935s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176475945 (13h42m55.401659012s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177490372 (13h42m55.402673449s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177539725 (13h42m55.402722771s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.178099717 (13h42m55.403282794s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.181059919 (13h42m55.406242966s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.182162520 (13h42m55.407345598s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184028706 (13h42m55.409211784s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184040439 (13h42m55.409223505s) [seg_pos={0 0}, upload=12031]: Segment reached optimal threshold of 13 pieces. Aug 26 05:46:40.184230777 (13h42m55.409413854s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184361141 (13h42m55.409544208s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184450850 (13h42m55.409633898s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184476368 (13h42m55.409659416s) [seg_pos={0 0}, upload=12031]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Aug 26 05:46:40.184580183 (13h42m55.40976323s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:46:40.184585603 (13h42m55.40976865s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:47.044131312 (13h43m2.2693144s) [upload=12031]: Done uploading segments... Aug 26 05:46:47.044152874 (13h43m2.269335951s) [upload=12031]: Upload finished. err: <nil> Duration: 2.299605454s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [...XXX....XXX......X....X...X......XX.X.XX....XX.XX.........] duration: 1.461233319s FAIL (2025-08-26 05:54:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.461254207s edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [.X....X...............X..X.........XX.........X.XX.X........] duration: 169.635114ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3AFB7EA3A7A1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:47:11 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=8tjmSuZMkvh Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:53:59 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AFB7EA3A7A1</RequestId><HostId></HostId></Error>" Duration: 169.652857ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [..X..X.XX....X..X..X..X.......XX.....XXXXX.....XX...........] duration: 511.209266ms FAIL (2025-08-26 05:53:58 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 511.245464ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 10 out of 60 is failed (threshold=3) [....XX.X.X.X.....X..X......................X.....X..X.......] duration: 772.44729ms FAIL (2025-08-26 05:53:56 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== O4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.337676887 (13h43m30.562859964s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.338323312 (13h43m30.563506388s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340398391 (13h43m30.565581469s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340778866 (13h43m30.565961953s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341147428 (13h43m30.566330505s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341604627 (13h43m30.566787705s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341967629 (13h43m30.567150706s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342312617 (13h43m30.567495705s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342682082 (13h43m30.56786516s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343107501 (13h43m30.568290578s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343696528 (13h43m30.568879605s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.347700131 (13h43m30.572883208s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.353294242 (13h43m30.578477318s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.357005705 (13h43m30.582188852s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360097525 (13h43m30.585280602s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360718501 (13h43m30.585901589s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.363118261 (13h43m30.588301337s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.442534509 (13h43m30.667717586s) [upload=12041]: Next returned nil segment Aug 26 05:47:15.442550258 (13h43m30.667733345s) [upload=12041]: Waiting for error group managing segments... Aug 26 05:47:15.451182057 (13h43m30.676365164s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.452462604 (13h43m30.677645681s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.454260442 (13h43m30.679443529s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.455280057 (13h43m30.680463144s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.456937692 (13h43m30.682120769s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.457694363 (13h43m30.68287745s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458098192 (13h43m30.68328127s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458479239 (13h43m30.683662315s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458886112 (13h43m30.684069199s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459042417 (13h43m30.684225493s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459511177 (13h43m30.684694254s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.468110394 (13h43m30.693293461s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.620114931 (13h43m30.845298009s) [noise=true , address=79.127.201.215:4349 , piece_id=5KA4X7E475FZVO4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663559442 (13h43m30.888742509s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663591131 (13h43m30.888774198s) [seg_pos={0 0}, upload=12041]: Segment reached optimal threshold of 14 pieces. Aug 26 05:47:15.663955185 (13h43m30.889138262s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection Aug 26 05:47:15.663980523 (13h43m30.88916359s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection Aug 26 05:47:15.664038241 (13h43m30.889221308s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:62488->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:47:15.664095149 (13h43m30.889278225s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection Aug 26 05:47:15.664159890 (13h43m30.889342967s) [seg_pos={0 0}, upload=12041]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:47:15.664249217 (13h43m30.889432295s) [upload=12041]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:47:15.664255018 (13h43m30.889438096s) [upload=12041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:47:26.126651265 (13h43m41.351834322s) [upload=12041]: Done uploading segments... Aug 26 05:47:26.126673085 (13h43m41.351856142s) [upload=12041]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 772.469862ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [X..X....X....X.......................X......................] duration: 225.765114ms remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:53:56 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 225.788418ms edge linksharing bgp us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 11 out of 60 is failed (threshold=3) [.X.....XX.XX....XX.................X...XX........X..........] duration: 193.495838ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3AEE0EB33B6A X-Request-Id=McQuPBREAb1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:46:14 GMT Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:53:49 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AEE0EB33B6A</RequestId><HostId></HostId></Error>" Duration: 193.568775ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [...XX.X.X.XX....X..X...XX.XXX..........X..XX................] duration: 527.622913ms FAIL (2025-08-26 05:53:41 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 527.651026ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [XX.XX..XXX....XX......XX..XX....X............XXX............] duration: 764.48005ms FAIL (2025-08-26 05:53:36 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 764.506811ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [...X.X..X.............XX...............XX........X..........] duration: 1.076970094s FAIL (2025-08-26 05:53:33 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3AEE3B34C493, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 1.076998166s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [..X....X...............X..X.........XX.........X.XX.X.......] duration: 149.644307ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3AFB7EA3A7A1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:47:11 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=8tjmSuZMkvh Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:53:26 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AFB7EA3A7A1</RequestId><HostId></HostId></Error>" Duration: 149.66731ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [.X.X.XX.XXXXX....X..X...X...X......X..XX.X.......XX.........] duration: 880.644157ms FAIL (2025-08-26 05:53:22 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:46:28.652260030 (13h42m43.877443077s) [upload=12031]: Starting upload Aug 26 05:46:28.652309312 (13h42m43.87749236s) [upload=12031]: Done starting upload Aug 26 05:46:28.652384173 (13h42m43.87756722s) [upload=12031]: Uploading segments... Aug 26 05:46:28.652505932 (13h42m43.877688979s) [upload=12031]: Got next segment. Inline: false Aug 26 05:46:28.652541158 (13h42m43.877724205s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:28.652544514 (13h42m43.877727551s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:46:40.061445530 (13h42m55.286628608s) [seg_pos={0 0}, upload=12031]: Begin upload segment... Aug 26 05:46:40.061488060 (13h42m55.286671137s) [seg_pos={0 0}, upload=12031]: Done begin upload segment. Aug 26 05:46:40.061554374 (13h42m55.286737452s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.061611752 (13h42m55.286794849s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062021513 (13h42m55.2872046s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062468782 (13h42m55.2876519s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062534026 (13h42m55.287717103s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063015901 (13h42m55.288198978s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063369004 (13h42m55.288552091s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063410292 (13h42m55.28859338s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063862080 (13h42m55.289045158s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064200546 (13h42m55.289383624s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064299062 (13h42m55.289482139s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064693774 (13h42m55.289876851s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064967658 (13h42m55.290150735s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065182031 (13h42m55.290365109s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065678393 (13h42m55.290861481s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.066367499 (13h42m55.291550586s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.166559082 (13h42m55.391742129s) [upload=12031]: Next returned nil segment Aug 26 05:46:40.166572948 (13h42m55.391755995s) [upload=12031]: Waiting for error group managing segments... Aug 26 05:46:40.173665544 (13h42m55.398848592s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.174842136 (13h42m55.400025202s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175255342 (13h42m55.400438389s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175557269 (13h42m55.400740356s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175698043 (13h42m55.400881081s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176056869 (13h42m55.401239935s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176475945 (13h42m55.401659012s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177490372 (13h42m55.402673449s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177539725 (13h42m55.402722771s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.178099717 (13h42m55.403282794s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.181059919 (13h42m55.406242966s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.182162520 (13h42m55.407345598s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184028706 (13h42m55.409211784s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184040439 (13h42m55.409223505s) [seg_pos={0 0}, upload=12031]: Segment reached optimal threshold of 13 pieces. Aug 26 05:46:40.184230777 (13h42m55.409413854s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184361141 (13h42m55.409544208s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184450850 (13h42m55.409633898s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184476368 (13h42m55.409659416s) [seg_pos={0 0}, upload=12031]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Aug 26 05:46:40.184580183 (13h42m55.40976323s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:46:40.184585603 (13h42m55.40976865s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:47.044131312 (13h43m2.2693144s) [upload=12031]: Done uploading segments... Aug 26 05:46:47.044152874 (13h43m2.269335951s) [upload=12031]: Upload finished. err: <nil> Duration: 880.66206ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 27 out of 60 is failed (threshold=3) [XXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX......XX.X.......] duration: 2.134603777s FAIL (2025-08-26 05:53:22 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.134625607s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [......X.X..XX.....X...................X.........XX..........] duration: 486.961481ms FAIL (2025-08-26 05:53:22 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:46:19.122249242 (13h42m34.347432309s) [upload=12027]: Starting upload Aug 26 05:46:19.122336606 (13h42m34.347519673s) [upload=12027]: Done starting upload Aug 26 05:46:19.122389295 (13h42m34.347572352s) [upload=12027]: Uploading segments... Aug 26 05:46:19.122426304 (13h42m34.347609352s) [upload=12027]: Got next segment. Inline: true Aug 26 05:46:19.122431003 (13h42m34.34761406s) [upload=12027]: Waiting for error group managing segments... Aug 26 05:46:19.122482891 (13h42m34.347665938s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:19.122487078 (13h42m34.347670135s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:46:19.122489442 (13h42m34.3476725s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:30.124196038 (13h42m45.349379106s) [upload=12027]: Done uploading segments... Aug 26 05:46:30.124211648 (13h42m45.349394705s) [upload=12027]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 486.978172ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [....X.X..X.............XX...............XX........X.........] duration: 1.066565479s FAIL (2025-08-26 05:53:05 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3AEE3B34C493, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 1.066586759s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 28 out of 60 is failed (threshold=3) [XXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX......XX.X......] duration: 2.90327875s FAIL (2025-08-26 05:53:04 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.903306764s core uplink us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [.X..X....X....X.......................X.....................] duration: 163.426956ms remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:52:58 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 163.450861ms edge linksharing bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 10 out of 60 is failed (threshold=3) [.....XX.X.X.X.....X..X......................X.....X..X......] duration: 928.577098ms FAIL (2025-08-26 05:52:57 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== O4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.337676887 (13h43m30.562859964s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.338323312 (13h43m30.563506388s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340398391 (13h43m30.565581469s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340778866 (13h43m30.565961953s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341147428 (13h43m30.566330505s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341604627 (13h43m30.566787705s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341967629 (13h43m30.567150706s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342312617 (13h43m30.567495705s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342682082 (13h43m30.56786516s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343107501 (13h43m30.568290578s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343696528 (13h43m30.568879605s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.347700131 (13h43m30.572883208s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.353294242 (13h43m30.578477318s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.357005705 (13h43m30.582188852s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360097525 (13h43m30.585280602s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360718501 (13h43m30.585901589s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.363118261 (13h43m30.588301337s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.442534509 (13h43m30.667717586s) [upload=12041]: Next returned nil segment Aug 26 05:47:15.442550258 (13h43m30.667733345s) [upload=12041]: Waiting for error group managing segments... Aug 26 05:47:15.451182057 (13h43m30.676365164s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.452462604 (13h43m30.677645681s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.454260442 (13h43m30.679443529s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.455280057 (13h43m30.680463144s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.456937692 (13h43m30.682120769s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.457694363 (13h43m30.68287745s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458098192 (13h43m30.68328127s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458479239 (13h43m30.683662315s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458886112 (13h43m30.684069199s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459042417 (13h43m30.684225493s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459511177 (13h43m30.684694254s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.468110394 (13h43m30.693293461s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.620114931 (13h43m30.845298009s) [noise=true , address=79.127.201.215:4349 , piece_id=5KA4X7E475FZVO4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663559442 (13h43m30.888742509s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663591131 (13h43m30.888774198s) [seg_pos={0 0}, upload=12041]: Segment reached optimal threshold of 14 pieces. Aug 26 05:47:15.663955185 (13h43m30.889138262s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection Aug 26 05:47:15.663980523 (13h43m30.88916359s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection Aug 26 05:47:15.664038241 (13h43m30.889221308s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:62488->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:47:15.664095149 (13h43m30.889278225s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection Aug 26 05:47:15.664159890 (13h43m30.889342967s) [seg_pos={0 0}, upload=12041]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:47:15.664249217 (13h43m30.889432295s) [upload=12041]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:47:15.664255018 (13h43m30.889438096s) [upload=12041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:47:26.126651265 (13h43m41.351834322s) [upload=12041]: Done uploading segments... Aug 26 05:47:26.126673085 (13h43m41.351856142s) [upload=12041]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 928.597556ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [....XXX....XXX......X....X...X......XX.X.XX....XX.XX........] duration: 874.20302ms FAIL (2025-08-26 05:52:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 874.224021ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [...X..X.XX....X..X..X..X.......XX.....XXXXX.....XX..........] duration: 667.894225ms FAIL (2025-08-26 05:52:47 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 667.925194ms core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 11 out of 60 is failed (threshold=3) [..X.....XX.XX....XX.................X...XX........X.........] duration: 171.175378ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3AEE0EB33B6A X-Request-Id=McQuPBREAb1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:46:14 GMT Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:52:39 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AEE0EB33B6A</RequestId><HostId></HostId></Error>" Duration: 171.22947ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [..X.X.XX.XXXXX....X..X...X...X......X..XX.X.......XX........] duration: 1.822644547s FAIL (2025-08-26 05:52:37 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:46:28.652260030 (13h42m43.877443077s) [upload=12031]: Starting upload Aug 26 05:46:28.652309312 (13h42m43.87749236s) [upload=12031]: Done starting upload Aug 26 05:46:28.652384173 (13h42m43.87756722s) [upload=12031]: Uploading segments... Aug 26 05:46:28.652505932 (13h42m43.877688979s) [upload=12031]: Got next segment. Inline: false Aug 26 05:46:28.652541158 (13h42m43.877724205s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:28.652544514 (13h42m43.877727551s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:46:40.061445530 (13h42m55.286628608s) [seg_pos={0 0}, upload=12031]: Begin upload segment... Aug 26 05:46:40.061488060 (13h42m55.286671137s) [seg_pos={0 0}, upload=12031]: Done begin upload segment. Aug 26 05:46:40.061554374 (13h42m55.286737452s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.061611752 (13h42m55.286794849s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062021513 (13h42m55.2872046s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062468782 (13h42m55.2876519s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062534026 (13h42m55.287717103s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063015901 (13h42m55.288198978s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063369004 (13h42m55.288552091s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063410292 (13h42m55.28859338s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063862080 (13h42m55.289045158s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064200546 (13h42m55.289383624s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064299062 (13h42m55.289482139s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064693774 (13h42m55.289876851s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064967658 (13h42m55.290150735s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065182031 (13h42m55.290365109s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065678393 (13h42m55.290861481s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.066367499 (13h42m55.291550586s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.166559082 (13h42m55.391742129s) [upload=12031]: Next returned nil segment Aug 26 05:46:40.166572948 (13h42m55.391755995s) [upload=12031]: Waiting for error group managing segments... Aug 26 05:46:40.173665544 (13h42m55.398848592s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.174842136 (13h42m55.400025202s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175255342 (13h42m55.400438389s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175557269 (13h42m55.400740356s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175698043 (13h42m55.400881081s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176056869 (13h42m55.401239935s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176475945 (13h42m55.401659012s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177490372 (13h42m55.402673449s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177539725 (13h42m55.402722771s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.178099717 (13h42m55.403282794s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.181059919 (13h42m55.406242966s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.182162520 (13h42m55.407345598s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184028706 (13h42m55.409211784s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184040439 (13h42m55.409223505s) [seg_pos={0 0}, upload=12031]: Segment reached optimal threshold of 13 pieces. Aug 26 05:46:40.184230777 (13h42m55.409413854s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184361141 (13h42m55.409544208s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184450850 (13h42m55.409633898s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184476368 (13h42m55.409659416s) [seg_pos={0 0}, upload=12031]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Aug 26 05:46:40.184580183 (13h42m55.40976323s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:46:40.184585603 (13h42m55.40976865s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:47.044131312 (13h43m2.2693144s) [upload=12031]: Done uploading segments... Aug 26 05:46:47.044152874 (13h43m2.269335951s) [upload=12031]: Upload finished. err: <nil> Duration: 1.822664364s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [....XX.X.X.XX....X..X...XX.XXX..........X..XX...............] duration: 531.881434ms FAIL (2025-08-26 05:52:36 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 531.910227ms core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [.XX.XX..XXX....XX......XX..XX....X............XXX...........] duration: 582.661188ms FAIL (2025-08-26 05:52:22 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 582.680404ms edge gateway us-select-1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [...X....X...............X..X.........XX.........X.XX.X......] duration: 239.942384ms remote: "tcp:136.0.77.2:443" response headers: Content-Length=423 Content-Security-Policy=block-all-mixed-content X-Amz-Request-Id=185F3AFB7EA3A7A1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:47:11 GMT Content-Type=application/xml Server=Storj Vary=Origin X-Request-Id=8tjmSuZMkvh Accept-Ranges=bytes target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222 FAIL (2025-08-26 05:52:19 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AFB7EA3A7A1</RequestId><HostId></HostId></Error>" Duration: 239.966049ms edge gateway vhost bgp us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [....X..X.XX....X..X..X..X.......XX.....XXXXX.....XX.........] duration: 545.388004ms FAIL (2025-08-26 05:52:18 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 545.410105ms core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [.....XXX....XXX......X....X...X......XX.X.XX....XX.XX.......] duration: 740.915093ms FAIL (2025-08-26 05:52:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 740.933998ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [.......X.X..XX.....X...................X.........XX.........] duration: 526.401103ms FAIL (2025-08-26 05:52:10 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:46:19.122249242 (13h42m34.347432309s) [upload=12027]: Starting upload Aug 26 05:46:19.122336606 (13h42m34.347519673s) [upload=12027]: Done starting upload Aug 26 05:46:19.122389295 (13h42m34.347572352s) [upload=12027]: Uploading segments... Aug 26 05:46:19.122426304 (13h42m34.347609352s) [upload=12027]: Got next segment. Inline: true Aug 26 05:46:19.122431003 (13h42m34.34761406s) [upload=12027]: Waiting for error group managing segments... Aug 26 05:46:19.122482891 (13h42m34.347665938s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:19.122487078 (13h42m34.347670135s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:46:19.122489442 (13h42m34.3476725s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:30.124196038 (13h42m45.349379106s) [upload=12027]: Done uploading segments... Aug 26 05:46:30.124211648 (13h42m45.349394705s) [upload=12027]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 526.417645ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 10 out of 60 is failed (threshold=3) [......XX.X.X.X.....X..X......................X.....X..X.....] duration: 1.266563851s FAIL (2025-08-26 05:52:03 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== O4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.337676887 (13h43m30.562859964s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.338323312 (13h43m30.563506388s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340398391 (13h43m30.565581469s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.340778866 (13h43m30.565961953s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341147428 (13h43m30.566330505s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341604627 (13h43m30.566787705s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.341967629 (13h43m30.567150706s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342312617 (13h43m30.567495705s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.342682082 (13h43m30.56786516s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343107501 (13h43m30.568290578s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.343696528 (13h43m30.568879605s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.347700131 (13h43m30.572883208s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.353294242 (13h43m30.578477318s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.357005705 (13h43m30.582188852s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360097525 (13h43m30.585280602s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.360718501 (13h43m30.585901589s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.363118261 (13h43m30.588301337s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Uploading piece... Aug 26 05:47:15.442534509 (13h43m30.667717586s) [upload=12041]: Next returned nil segment Aug 26 05:47:15.442550258 (13h43m30.667733345s) [upload=12041]: Waiting for error group managing segments... Aug 26 05:47:15.451182057 (13h43m30.676365164s) [noise=true , address=77.90.31.18:4821 , piece_id=RSEEETAXPX2UNFT3NAGVQIDD6HZXMX2BRHMKMTVXPNWVXKFVSYXQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.452462604 (13h43m30.677645681s) [noise=true , address=79.127.219.47:4065 , piece_id=J774Z6CPOJBLVO4KC2ODC2FMFRG5LQYLHL2LFQF3AR4SWD2CD6BQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.454260442 (13h43m30.679443529s) [noise=true , address=45.91.116.6:4002 , piece_id=42SYNFZV4JY4CHJ4KHGEPLK5BY3PVIII66CTFE4I4SAJLVELULYQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.455280057 (13h43m30.680463144s) [noise=true , address=77.90.31.15:4717 , piece_id=5I67NYFJRZT7ORPYPVSJA56BB4LYVB3WUQOE7ZXFFHTCHMI2TYVQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.456937692 (13h43m30.682120769s) [noise=true , address=104.36.82.5:4848 , piece_id=YPQNRHC7BMQET4FH3IOP3WVAY6D3H5FCVJSSIYWL6KAJ43GFPDWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.457694363 (13h43m30.68287745s) [noise=true , address=104.36.82.11:4128 , piece_id=QIDJJMBP36RUA4XXQ2Q2HDF2R4DW53A222OEQEWA2AMX6RSQCVFA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458098192 (13h43m30.68328127s) [noise=true , address=104.36.82.11:4140 , piece_id=BA5JUOEPAD4TNNCFEHMQ5KO3CDJJ5L56GDXZMT6VIGGBXCETBYGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458479239 (13h43m30.683662315s) [noise=true , address=104.36.82.23:4466 , piece_id=U6DXP2ADNBE657QXHKT633JIV66ROOTRQKF4B7OAJTVDOV3CRLUA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.458886112 (13h43m30.684069199s) [noise=true , address=104.36.82.44:4890 , piece_id=NYLN3X5UXITCKCFZ6E2WIGI7WZV7USAFIEMUNESNBYU4BVOKAW5Q, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459042417 (13h43m30.684225493s) [noise=true , address=104.36.82.50:4017 , piece_id=VXMNPE5WHITPQP7LQUDAEYAN6LYYWPWIR6BTE2FJXECSXKQAHVWQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.459511177 (13h43m30.684694254s) [noise=true , address=104.36.82.60:4365 , piece_id=IOYRFBESQVMDVOEH677WCO6CDSU6LOMQOZQOMMXT2QSEAXDRLFWA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.468110394 (13h43m30.693293461s) [noise=true , address=77.90.31.19:4855 , piece_id=NCMORUSZ6XAEPRPT4YPXHWIZGP5BVLWCDCNBTOC7ECK6QMU22WFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.620114931 (13h43m30.845298009s) [noise=true , address=79.127.201.215:4349 , piece_id=5KA4X7E475FZVO4JMKFA5RN4IQN2CRCW5VBPYXLMYFOX3VA7ICGQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663559442 (13h43m30.888742509s) [noise=true , address=77.90.31.16:4752 , piece_id=FKJQ66EGGM57CJOCPKD4V4K4YGWGRQJTFVA5JK2YZBOUFO2KFQDA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: <nil> Aug 26 05:47:15.663591131 (13h43m30.888774198s) [seg_pos={0 0}, upload=12041]: Segment reached optimal threshold of 14 pieces. Aug 26 05:47:15.663955185 (13h43m30.889138262s) [noise=true , address=79.127.205.245:4220 , piece_id=FPXMKCW6YUM5CGTJ27UUGSXZE7VZ6MS542O3H4NYHAKYPM5U4OFQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123xj8bTNShfvqNJh3mSvM6V4TeXQoxFHR5TKELoUKTJJTzDyjD): protocol: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33592->79.127.205.245:4220: use of closed network connection Aug 26 05:47:15.663980523 (13h43m30.88916359s) [noise=true , address=79.127.205.246:4284 , piece_id=EC3P5P5T2ODWFBH4VQ3666AR3TSW3LJZKZU7P2UFB76V22RD5VQQ, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1z7gUykS9V5o6wvXSCmK5jBvXK6XAqck4Z348Ryz97PLEyVtD2): protocol: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:61910->79.127.205.246:4284: use of closed network connection Aug 26 05:47:15.664038241 (13h43m30.889221308s) [noise=true , address=64.49.13.154:4934 , piece_id=KDCFYU63FXZ4BHOYEGGO5VC6M3KC7JMERNSY5F24HM7TWJ2PRVHA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: read tcp 5.161.89.252:62488->64.49.13.154:4934: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 26 05:47:15.664095149 (13h43m30.889278225s) [noise=true , address=79.127.205.234:4619 , piece_id=KURMGY53IW7WE6SMXSLZDFDMO6SSSILYL66NBM54LRPAZ3HVZXQA, seg_pos={0 0}, upload=12041]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1yrNdQVXCpM81T6PiYFQKrHiesKtqcQAAMExwqxTeQsSqH6BAK): protocol: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection; piecestore: piecestore close: write tcp 5.161.89.252:33526->79.127.205.234:4619: use of closed network connection Aug 26 05:47:15.664159890 (13h43m30.889342967s) [seg_pos={0 0}, upload=12041]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 26 05:47:15.664249217 (13h43m30.889432295s) [upload=12041]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:47:15.664255018 (13h43m30.889438096s) [upload=12041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:47:26.126651265 (13h43m41.351834322s) [upload=12041]: Done uploading segments... Aug 26 05:47:26.126673085 (13h43m41.351856142s) [upload=12041]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 1.266587164s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [..XX.XX..XXX....XX......XX..XX....X............XXX..........] duration: 579.453916ms FAIL (2025-08-26 05:52:03 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 579.469044ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 8 out of 60 is failed (threshold=3) [.....X.X..X.............XX...............XX........X........] duration: 930.585355ms FAIL (2025-08-26 05:52:02 UTC) operation error S3: GetObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 185F3AEE3B34C493, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled) Duration: 930.784189ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 11 out of 60 is failed (threshold=3) [...X.....XX.XX....XX.................X...XX........X........] duration: 220.150672ms remote: "tcp:45.38.24.2:443" response headers: Content-Type=application/xml Server=Storj X-Amz-Request-Id=185F3AEE0EB33B6A X-Request-Id=McQuPBREAb1 X-Xss-Protection=1; mode=block Date=Tue, 26 Aug 2025 05:46:14 GMT Accept-Ranges=bytes Content-Length=433 Content-Security-Policy=block-all-mixed-content Vary=Origin target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-26 05:52:01 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error><Code>InternalError</Code><Message>We encountered an internal error, please try again.: cause(uplink: metaclient: accounting backend: Redis eval failed: dial tcp 10.37.0.83:6379: operation was canceled)</Message><Key>hello-world.txt</Key><BucketName>uptime-checks-us-select</BucketName><Resource>/hello-world.txt</Resource><RequestId>185F3AEE0EB33B6A</RequestId><HostId></HostId></Error>" Duration: 220.170621ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 29 out of 60 is failed (threshold=3) [XXXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX......XX.X.....] duration: 2.182786568s FAIL (2025-08-26 05:51:57 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.182818298s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 18 out of 60 is failed (threshold=3) [X....X..X.XX....X..X..X..X.......XX.....XXXXX.....XX........] duration: 675.631511ms FAIL (2025-08-26 05:51:47 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 675.655867ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 16 out of 60 is failed (threshold=3) [.....XX.X.X.XX....X..X...XX.XXX..........X..XX..............] duration: 597.182687ms FAIL (2025-08-26 05:51:45 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:40:50.174916229 (13h37m5.400099286s) [upload=11948]: Starting upload Aug 26 05:40:50.174950314 (13h37m5.400133371s) [upload=11948]: Done starting upload Aug 26 05:40:50.174991591 (13h37m5.400174638s) [upload=11948]: Uploading segments... Aug 26 05:40:50.175014524 (13h37m5.400197571s) [upload=11948]: Got next segment. Inline: true Aug 26 05:40:50.175017720 (13h37m5.400200767s) [upload=11948]: Waiting for error group managing segments... Aug 26 05:40:50.175043148 (13h37m5.400226195s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:40:50.175046144 (13h37m5.400229191s) [upload=11948]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:40:50.175048268 (13h37m5.400231315s) [upload=11948]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:41:09.312511333 (13h37m24.53769439s) [upload=11948]: Done uploading segments... Aug 26 05:41:09.312532192 (13h37m24.537715249s) [upload=11948]: Upload finished. err: <nil> Duration:* 597.236198ms core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [..X..X....X....X.......................X....................] duration: 241.037778ms remote: "tcp:136.0.77.2:443" response headers: Access-Control-Allow-Methods=GET, HEAD X-Request-Id=ZFwx4y7eAxE Content-Type=text/html; charset=utf-8 Accept-Ranges=bytes Access-Control-Allow-Headers=* Access-Control-Allow-Origin=* Date=Tue, 26 Aug 2025 05:38:38 GMT target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-08-26 05:51:44 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "<!DOCTYPE html>\n<html lang=\"en\">\n\n<head>\n <meta charset=\"utf-8\">\n <title>Error \| Storj</title>\n\n <meta property=\"og:url\" content=\"https://link.storjshare.io\" />\n <meta property=\"og:title\" content=\"Error \| Storj\" />\n <meta property=\"og:description\" name=\"description\" content=\"Shared content - Storj\" />\n \n <meta property=\"og:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <meta name=\"twitter:card\" content=\"summary\" />\n <meta name=\"twitter:site\" content=\"@storj\" />\n <meta name=\"twitter:title\" content=\"Error \| Storj\" />\n <meta name=\"twitter:description\" content=\"Shared content - Storj\" />\n \n <meta name=\"twitter:image\" content=\"https://link.storjshare.io/static/img/file.png?v=f0d1e95\" />\n \n\n <link rel=\"shortcut icon\"\n href=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAIAAAD8GO2jAAAC40lEQVRIDe1US0iUURQ+V8fJmcnykTJmNA0tMszETUVlCrkoR+2lWdFDk7AHlNQiCGaREhlUli3ETSRFqx4UlAi5ySgqS8hQiXLMTKca35k6j3O6d5zE//rnuNCF4Mdd3HvO+c53/3P/cxgRwUwiY" Duration: 241.060569ms edge linksharing bgp us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [......XXX....XXX......X....X...X......XX.X.XX....XX.XX......] duration: 750.936595ms FAIL (2025-08-26 05:51:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 750.96126ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 8 out of 60 is failed (threshold=3) [........X.X..XX.....X...................X.........XX........] duration: 570.974345ms FAIL (2025-08-26 05:51:37 UTC) operation: Commit ======ERROR====== uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled ======LOGS====== Aug 26 05:46:19.122249242 (13h42m34.347432309s) [upload=12027]: Starting upload Aug 26 05:46:19.122336606 (13h42m34.347519673s) [upload=12027]: Done starting upload Aug 26 05:46:19.122389295 (13h42m34.347572352s) [upload=12027]: Uploading segments... Aug 26 05:46:19.122426304 (13h42m34.347609352s) [upload=12027]: Got next segment. Inline: true Aug 26 05:46:19.122431003 (13h42m34.34761406s) [upload=12027]: Waiting for error group managing segments... Aug 26 05:46:19.122482891 (13h42m34.347665938s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:19.122487078 (13h42m34.347670135s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 26 05:46:19.122489442 (13h42m34.3476725s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:30.124196038 (13h42m45.349379106s) [upload=12027]: Done uploading segments... Aug 26 05:46:30.124211648 (13h42m45.349394705s) [upload=12027]: Upload finished. err: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration:* 570.997318ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 19 out of 60 is failed (threshold=3) [...X.X.XX.XXXXX....X..X...X...X......X..XX.X.......XX.......] duration: 2.589535947s FAIL (2025-08-26 05:51:35 UTC) operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Aug 26 05:46:28.652260030 (13h42m43.877443077s) [upload=12031]: Starting upload Aug 26 05:46:28.652309312 (13h42m43.87749236s) [upload=12031]: Done starting upload Aug 26 05:46:28.652384173 (13h42m43.87756722s) [upload=12031]: Uploading segments... Aug 26 05:46:28.652505932 (13h42m43.877688979s) [upload=12031]: Got next segment. Inline: false Aug 26 05:46:28.652541158 (13h42m43.877724205s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 26 05:46:28.652544514 (13h42m43.877727551s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 26 05:46:40.061445530 (13h42m55.286628608s) [seg_pos={0 0}, upload=12031]: Begin upload segment... Aug 26 05:46:40.061488060 (13h42m55.286671137s) [seg_pos={0 0}, upload=12031]: Done begin upload segment. Aug 26 05:46:40.061554374 (13h42m55.286737452s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.061611752 (13h42m55.286794849s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062021513 (13h42m55.2872046s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062468782 (13h42m55.2876519s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.062534026 (13h42m55.287717103s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063015901 (13h42m55.288198978s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063369004 (13h42m55.288552091s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063410292 (13h42m55.28859338s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.063862080 (13h42m55.289045158s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064200546 (13h42m55.289383624s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064299062 (13h42m55.289482139s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064693774 (13h42m55.289876851s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.064967658 (13h42m55.290150735s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065182031 (13h42m55.290365109s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.065678393 (13h42m55.290861481s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.066367499 (13h42m55.291550586s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Uploading piece... Aug 26 05:46:40.166559082 (13h42m55.391742129s) [upload=12031]: Next returned nil segment Aug 26 05:46:40.166572948 (13h42m55.391755995s) [upload=12031]: Waiting for error group managing segments... Aug 26 05:46:40.173665544 (13h42m55.398848592s) [noise=true , address=45.91.116.5:4299 , piece_id=UI5RNMFCDMEEVW2AI5NCQBMS4IULHKTWRM4GA6Q2GXWN7NCFHUHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.174842136 (13h42m55.400025202s) [noise=true , address=45.91.116.8:4047 , piece_id=E66WZM7JPHLX5DC6HIYJS6PIVUIVN75KRLW66CHVPZEQUB7RHHNA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175255342 (13h42m55.400438389s) [noise=true , address=77.90.31.16:4735 , piece_id=QBSRWDX6MKEAF3FBJ2ZPBRDRNDVJYR5UV5NAEGZGDK2NSWFHRLZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175557269 (13h42m55.400740356s) [noise=true , address=45.91.116.5:4297 , piece_id=AFE5WDDJLDOI56R57TNEX7AHXMOR4EDINRMBCLG6BODWKKA7BOTQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.175698043 (13h42m55.400881081s) [noise=true , address=45.91.116.11:4117 , piece_id=A3ZS3F2HM26OC4AT3ZXQCE4VUA7S77ACXYABZ4K5DZU5ZHASK7MA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176056869 (13h42m55.401239935s) [noise=true , address=45.91.116.12:4227 , piece_id=AVRMTCXUZCZKO7ADTQHFSPVSMDOTGCP5QIVSS73P27JG7TWZIOMQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.176475945 (13h42m55.401659012s) [noise=true , address=77.90.31.21:4878 , piece_id=DWQ5MI6AF7FF655CC3UBNUU35Y3VJCGFOPLQ2FLJBIWXMBU4DLYQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177490372 (13h42m55.402673449s) [noise=true , address=77.90.31.13:4627 , piece_id=LE6PYVEVSAVB7JMKR3MJSHFP2ZTJMLTWSVX2WS2DMVKWKOM4TKZA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.177539725 (13h42m55.402722771s) [noise=true , address=45.91.116.13:4155 , piece_id=NHY7PPHPYITMIDCFDHOBBHGWZXGOOUHPUNSMPEU4DVH5XCZCBY3A, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.178099717 (13h42m55.403282794s) [noise=true , address=45.91.116.7:4010 , piece_id=FH277WUIQEUP5HUFCO534CCX5APWHIKG7V7QSIYBKLNP43ULPN7Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.181059919 (13h42m55.406242966s) [noise=true , address=104.36.82.14:4221 , piece_id=GO4OPUXGJDX5IMH52JBQIIH4TOLOUCR5PQKVR2N4BUEOXNV5LLFQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.182162520 (13h42m55.407345598s) [noise=true , address=104.36.82.7:4911 , piece_id=KVBWTVBSMJRTDLSUU2BL2OVB3SW4DMDBBD2JM7VMKEQCZGDU7JHQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184028706 (13h42m55.409211784s) [noise=true , address=45.91.116.4:4940 , piece_id=3MVHQWYSPY7PCF3ZFT7BUAN62XYFENEEOA3B3LDGTM6HL3BI42ZQ, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184040439 (13h42m55.409223505s) [seg_pos={0 0}, upload=12031]: Segment reached optimal threshold of 13 pieces. Aug 26 05:46:40.184230777 (13h42m55.409413854s) [noise=true , address=104.36.82.3:4767 , piece_id=URSW43FTPDWCPL2TMRGZZTDESJDGBARFPYEW43WE7OHNDD75JF3Q, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184361141 (13h42m55.409544208s) [noise=true , address=104.36.82.2:4729 , piece_id=HDVV3RUIKIXMW6TKHJJVXDDK75MGT6FMDWTSBBL54MXY6M6CETEA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR): protocol: expected piece hash; context canceled; EOF Aug 26 05:46:40.184450850 (13h42m55.409633898s) [noise=true , address=104.36.82.2:4732 , piece_id=2XHPT7TCG4P6ID3VYBIA4T5MLDKJFJIKIDQRDNVNLC6L2TCDNYXA, seg_pos={0 0}, upload=12031]: Done uploading piece. err: <nil> Aug 26 05:46:40.184476368 (13h42m55.409659416s) [seg_pos={0 0}, upload=12031]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Aug 26 05:46:40.184580183 (13h42m55.40976323s) [upload=12031]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 26 05:46:40.184585603 (13h42m55.40976865s) [upload=12031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 26 05:46:47.044131312 (13h43m2.2693144s) [upload=12031]: Done uploading segments... Aug 26 05:46:47.044152874 (13h43m2.269335951s) [upload=12031]: Upload finished. err: <nil> Duration: 2.589557848s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 17 out of 60 is failed (threshold=3) [...XX.XX..XXX....XX......XX..XX....X............XXX.........] duration: 715.6689ms FAIL (2025-08-26 05:51:31 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 715.682515ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 19 out of 60 is failed (threshold=3) [XX....X..X.XX....X..X..X..X.......XX.....XXXXX.....XX.......] duration: 498.935064ms FAIL (2025-08-26 05:51:23 UTC) operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 498.96472ms core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 29 out of 60 is failed (threshold=3) [.XXXXXXXX.XX.......X..XX.XXXXXXX.....XX..X.XXX......XX.X....] duration: 2.14038114s FAIL (2025-08-26 05:51:21 UTC) operation: Commit uplink: metaclient: accounting backend: Redis pipeline exec failed: dial tcp 10.37.0.83:6379: operation was canceled Duration: 2.140403712s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jw7f74fzbtwblz3mwqolmnivikxq&Signature=azz0x2J96uUqIe6sG77G4wqaf50%3D&Expires=1771549222", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_us_qa_orbiter_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_us_qa_orbiter_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)